What is Single Origin?

Single Origin is an automated data semantic platform that dedupes, simplifies and optimizes queries, pipelines, models at scale in 3 simple steps:

• Group similar queries sharing similar table scans and filters: Single Origin augments the engineering team with unique, accurate and actionable insights (query cost by table; flag fan-out sub query/CTE with rollupable, non-rollupable or both; collect the column usage in where, select, join, having and group by clauses) . All the above insights inform users to create an optimized materialized view or derived table.
• Register the materialized view(MV) or derived table: users can draft a sql logic for the materialized view and test how many queries would be optimized. Single Origin will automate this process as more data profiling info: cardinality and value distribution for columns are available.
• Identify the potential queries which can be optimized on MV; and rewrite: once the materialized view is registered, Single Origin will detect future queries to be optimized and rewrite based on the algebra relation of materialized views and queries.