What is Single Origin?
Single Origin is an automated data semantic platform that dedupes, simplifies and optimizes queries, pipelines, models at scale in 3 simple steps:
- Group similar queries sharing similar table scans and filters: Single Origin augments the engineering team with unique, accurate and actionable insights (query cost by table; flag fan-out sub query/CTE with rollupable, non-rollupable or both; collect the column usage in where, select, join, having and group by clauses) . All the above insights inform users to create an optimized materialized view or derived table.
- Register the materialized view(MV) or derived table: users can draft a sql logic for the materialized view and test how many queries would be optimized. Single Origin will automate this process as more data profiling info: cardinality and value distribution for columns are available.
- Identify the potential queries which can be optimized on MV; and rewrite: once the materialized view is registered, Single Origin will detect future queries to be optimized and rewrite based on the algebra relation of materialized views and queries.
Updated 22 days ago