What is Single Origin?
Single Origin is an automated data semantic platform that dedupes, simplifies and optimizes queries, pipelines, tables at scale in 3 simple steps:
- Group similar queries sharing similar table scans and filters: Single Origin augments the engineering team with unique, accurate and actionable insights (query cost by table; flag fan-out sub query/CTE with rollupable, non-rollupable or both; collect the column usage in where, select, join, having and group by clauses) . All the above insights inform users to create an optimized materialized view or consolidated query.
- Derive the optimal shared compute logic for a materialized view or a consolidated query: users can draft a sql logic and test how many queries would be optimized. Single Origin will automate this process as more data profiling info: cardinality and value distribution for columns, and index configurations are available.
- Identify the potential queries which can be optimized and rewritten: once a materialized view is registered, Single Origin will detect future queries to be optimized and rewrite based on the algebra relation of materialized views and queries.
Updated 3 days ago