Skip to content

Timeline and Dependencies

This document maps dependencies between epics and tasks across all Intelligence Architecture projects. Use this to identify the critical path, parallel work opportunities, and blocking relationships.



Epic-to-Epic Dependencies

Critical Path (must be built in order)

Platform Core (Shared Types)

        ├──► DMC Vertical (Post-Spike)
        │         │
        │         ├──► DMC Data Enrichment
        │         ├──► DMC Data Quality
        │         └──► DMC Advanced Extraction

        ├──► Dining Vertical
        ├──► Experiences Vertical
        ├──► Transportation Vertical
        ├──► Hotels Vertical
        ├──► Flights Vertical
        ├──► Spa & Wellness Vertical
        └──► Event Tickets Vertical

                  └──► Cross-Vertical Search

                            ├──► Entity Resolution
                            └──► Itinerary Construction

Dependency Matrix

EpicDepends OnBlocked ByEnables
DMC Vertical
DMC Data EnrichmentPlatform Core (shared types)DMC Data Quality
DMC Data QualityDMC Data EnrichmentDMC Advanced Extraction
DMC Advanced ExtractionDMC Data QualityProduction readiness
Dining Vertical
Dining Data AcquisitionPlatform CoreDining Schema
Dining Schema and StorageDining Data AcquisitionDining Agent Integration
Dining Integration with AgentDining SchemaAgent system
Experiences Vertical
Experiences Data AcquisitionPlatform CoreExperiences Schema
Experiences Schema and StorageExperiences Data AcquisitionBooking Integration
Experiences Booking IntegrationExperiences SchemaAgent system
Transportation Vertical
Transportation Data AcquisitionPlatform CoreOAuth requirementsTransportation Schema
Transportation Schema and StorageTransportation Data AcquisitionAgent system
Hotels Vertical
Hotels Data AcquisitionPlatform CoreHotels Schema
Hotels Schema and StorageHotels Data AcquisitionReal-Time Integration
Hotels Real-Time IntegrationHotels SchemaAgent system
Flights Vertical
Flights Data AcquisitionPlatform CoreGDS relationshipsFlights Schema
Flights Schema and StorageFlights Data AcquisitionAgent system
Spa & Wellness Vertical
Spa & Wellness Data AcquisitionPlatform CoreSchema
Spa & Wellness Schema and StorageData AcquisitionAgent system
Event Tickets Vertical
Event Tickets Data AcquisitionPlatform CoreSchema
Event Tickets Schema and StorageData AcquisitionAgent system
Platform Core
Unified Data ModelsCross-vertical search
Cross-Vertical SearchUnified Data Models, 2+ verticalsEntity Resolution
Entity ResolutionCross-Vertical SearchItinerary Construction
Itinerary ConstructionEntity ResolutionAgent system
Platform InfrastructureAll verticalsProduction readiness
Platform Operations
Crawler Framework EnhancementsAll verticals
Data Quality MonitoringAll verticalsProduction readiness
Observability PipelineAlerting
Production DeploymentAll aboveGo-live

Task-Level Dependencies Within Epics

DMC Vertical (Post-Spike)

TaskDepends OnNotes
Implement DMC Finder crawlerPlatform Core10,000+ DMCs, 120+ countries
Build Traveller Made enrichmentDMC Finder
Implement Virtuoso advisor networkTraveller Made20,000+ luxury advisors
Build cross-source deduplicationAll sources
Implement email validation (MX check)Extraction
Build phone normalization (E.164)Extraction
Implement confidence scoringExtraction
Build department-specific email extractionExtractionreservations@, sales@, booking@
Implement JS-rendered contact page handlingExtraction
Build PDF brochure parsingExtraction
Implement cookie consent handlingExtraction
Docker containerizationAll above
Implement incremental crawl supportCrawler framework
Build rate limit enforcement per sourceCrawler framework
Implement error alertingObservability

Dining Vertical

TaskDepends OnNotes
Build Resy crawler with rate limitingPlatform Core
Build OpenTable crawlerPlatform CoreParallel with Resy
Build Yelp crawlerPlatform CoreParallel with Resy
Build Tock crawlerPlatform CoreParallel with Resy
Design restaurant data modelCan start early
Implement SQLite tables for diningData model
Build FTS5 search on restaurant fieldsSQLite tables
Implement restaurant-specific MCP toolsFTS5, Data modelsearch_restaurant, get_restaurant_details, list_cuisines, find_by_city, catalog_stats
Connect Dining Research Agent to MCP serverMCP tools
Implement real-time availability checksPartner APIs
Build time-slot display in Advisor ConsoleAvailability

Experiences Vertical

TaskDepends OnNotes
Build Viator crawlerPlatform Core
Build GetYourGuide crawlerPlatform CoreParallel with Viator
Build Klook crawlerPlatform CoreParallel with Viator
Handle partner API authenticationAll crawlers
Design experience data modelCan start early
Implement SQLite tables and FTS5Data model
Build experiences-specific MCP toolsFTS5, Data model
Implement availability checkingPartner APIs
Build booking flow integrationAvailabilityHand-off to Atlantes

Transportation Vertical

TaskDepends OnNotes
Build Uber crawler/API integrationPlatform CoreOAuth required
Build Lyft crawler/API integrationPlatform CoreParallel with Uber
Build Blacklane crawler/API integrationPlatform CoreParallel with Uber
Build car rental API integrationsPlatform CoreParallel with Uber
Handle OAuth requirementsAll crawlers
Design transportation data modelCan start early
Implement SQLite tables and FTS5Data model
Build transportation-specific MCP toolsFTS5, Data model

Hotels Vertical

TaskDepends OnNotes
Build Booking.com crawlerPlatform Core
Build Expedia crawlerPlatform CoreParallel with Booking.com
Build Virtuoso integrationPlatform CoreLuxury-specific
Design hotel data modelCan start early
Implement SQLite tables and FTS5Data model
Build hotel-specific MCP toolsFTS5, Data model
Implement real-time availability checkingPartner APIs
Build pricing API integrationAvailability
Implement room type and amenity filteringPricing

Flights Vertical

TaskDepends OnNotes
Build Amadeus API integrationPlatform Core
Build Skyscanner crawlerPlatform CoreParallel with Amadeus
Build Google Flights crawlerPlatform CoreParallel with Amadeus
Handle GDS-dependent partner relationshipsAll crawlers
Design flight data modelCan start early
Implement SQLite tables and FTS5Data model
Build flight-specific MCP toolsFTS5, Data model

Platform Core

TaskDepends OnNotes
Define shared base types (Location, Contact)Start here
Implement cross-vertical schema consistencyBase types
Build schema versioning and migration systemSchema consistency
Implement search_destination tool2+ verticals
Build ranking and filtering across verticalssearch_destination
Implement cross-vertical result mergingRanking
Build EntityResolverCross-vertical search
Implement deduplication across verticalsEntityResolver
Implement suggest_itinerary toolEntity Resolution
Build itinerary ranking and recommendationItinerary tool
Implement Docker + CI/CD pipelineCan start early
Build monitoring and alertingObservability
Implement caching layer (Redis)Can start early
Build user authentication (JWT)Can start early
Implement notification systemCan start early

Platform Operations

TaskDepends OnNotes
Implement incremental crawlingCrawler framework
Build change detection for directory pagesIncremental crawl
Implement on-demand re-crawlIncremental crawl
Implement per-vertical coverage metricsAll verticals
Build quality regression alertsCoverage metrics
Implement freshness trackingAll verticals
Build stale record alertingFreshness tracking
Implement Prometheus metrics endpointCan start early
Build structured JSON loggingCan start early
Implement per-record tracingCan start early
Build source health trackingStructured logging
Build k8s CronJob schedulingContainer image
Implement SQLite backup to object storagePersistent volume
Build MCP server HTTP/SSE transportMCP server
Implement health and readiness probesMCP server
Build CI/CD pipelineAll aboveLast task

Parallel Work Opportunities

Wave 1 (can start immediately)

  • Platform Core (shared types, schema)
  • Crawler Framework Enhancements (incremental crawl)
  • Observability Pipeline (Prometheus, logging)
  • DMC Vertical (post-spike work)

Wave 2 (after Platform Core)

  • Dining Vertical (acquisition + schema)
  • Experiences Vertical (acquisition + schema)
  • Hotels Vertical (acquisition + schema)
  • Flights Vertical (acquisition + schema)
  • Transportation Vertical (acquisition + schema)
  • Spa & Wellness Vertical (acquisition + schema)
  • Event Tickets Vertical (acquisition + schema)

Wave 3 (after Wave 2 verticals)

  • DMC Data Enrichment + Quality + Advanced Extraction
  • MCP Server Production Transport
  • Data Quality Monitoring

Wave 4 (after multiple verticals exist)

  • Cross-Vertical Search
  • Entity Resolution

Wave 5 (after Entity Resolution)

  • Itinerary Construction

Wave 6 (after all above)

  • Platform Infrastructure (CI/CD, auth, caching)
  • Production Deployment

Critical Path Summary

The minimum viable path to a working Intelligence Platform:

1. Platform Core (shared types, Location, Contact)
2. DMC Vertical (post-spike: enrichment, quality, extraction)
3. Dining Vertical (acquisition, schema, MCP tools)
4. MCP Server Production Transport (HTTP/SSE)
5. Crawler Framework Enhancements (incremental crawl)
6. Observability Pipeline (metrics, logging, alerts)
7. Data Quality Monitoring
8. Production Deployment

Estimated critical path: ~10-12 weeks if fully staffed and unblocked.


Risk Areas

RiskImpactMitigation
Partner API access delaysHighStart with public sources, escalate API access
JS-rendered pages block extractionMediumUse Playwright for specific sources, or accept lower coverage
Data quality regressionsMediumImplement quality monitoring early, alert on regressions
SQLite scaling limitsLowMonitor growth, plan Postgres migration at 10x
Cross-vertical search complexityMediumStart with simple ranking, iterate based on agent feedback
OAuth requirements for TransportationHighStart OAuth flows early, escalate partner conversations

Marchay Platform Documentation