What is Single Origin?
Single Origin is an automated data semantic platform that dedupes, simplifies, and optimizes queries, pipelines, and tables at scale in 3 simple steps:
- Group similar queries sharing similar table scans and filters: Single Origin augments the engineering team with top-to-bottom insights of query costs by tables, similar query groups within a table, and operators/stages (scans, join, aggregation, etc) within a query. All the above insights inform users to create an optimized materialized view or consolidated query.
- Derive the optimal shared compute logic for a materialized view or a consolidated query: Users can draft SQL logic and test how many queries would be optimized. Single Origin will automate this process as more data profiling information, such as cardinality and value distribution for columns and index configurations, is available.
- Identify the potential queries that can be optimized and rewritten: Once a materialized view is registered, Single Origin will detect future queries to be optimized and rewritten based on the algebra relation of materialized views and queries.
Updated 4 days ago