Skip to content

Text spotter for different map styles #1

@zekun-li

Description

@zekun-li
  • 1. Extract patch-level feature with trained contrastive model for >50K map images
  • 2. Compute map-level features from patch-level features (either clustering or simple averaging)
  • 3. Divide (cluster) map-level features into <10 groups
  • 4. Train cycleGAN model to learn style transfer with OSM and rumsey maps as input (# models depends on # clusters)
  • 5. Produce synthetic maps backgrounds with cycleGAN with OSM maps as input (synthetic map backgrounds do NOT contain text)
  • 6. Generate text layer with QGIS using various font sizes, styles , orientation and curving
  • 7. Combine synthetic map background and text layer to form complete map
  • 8. Calculate the ground-truth bounding polygon & text string for text layer ,and save output in TESTR compatible format (some effort required to handle truncated text)
  • 9. Fine-tune TESTR with the synthetic map data
  • 10. Evaluate the results and compare with other TESTR versions

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions