Bigmetadata ETL Docs¶
All data for CARTO’s Data Observatory is obtained through tasks built subclassing Bigmetadata ETL classes.
The classes themselves are derived from Luigi tasks.
By performing the ETL using these classes, we gain a few guarantees:
- Reproduceability, and avoidance of duplicate work
- Generation of high-quality metadata consumable by the Observatory API
- Scalability across multiple processes
Contents: