Accelerating Data Migration to Google Cloud with the Datametica Bird Product Suite

In October 2023, Onix announced the release of new AI and data solutions after the company’s acquisition of Datametica. With this announcement, Onix is ready with next-gen solutions in data migration and modernization that deliver the following capabilities:

• Data migration from legacy and cloud-powered warehouses
• Data integration
• Business intelligence (BI) 
• Vertex AI and Gemini (formerly Duet AI) deployments

Datametica has its proprietary suite of data transformation products – also referred to as Datametica Birds, namely:

• Eagle – The Planner
• Raven – The Transformer
• Pelican – The Validator

In this blog, we will delve deeper into the capabilities and benefits of each of the Datametica Birds.

Eagle – The Planner

Here are some of the core features of the Eagle tool:

1. Detailed assessment of data warehouses
   Organizations can generate an accurate and detailed assessment of their data warehouses within a few weeks. They can also identify and prioritize data workloads fit for cloud migration. Data warehouse assessment also recommends the best data models for migration. 
2. Cloud migration planning
   With this Eagle feature, organizations can develop their cloud migration strategy, along with identifying the data to be migrated, the detailed migration steps, and the onboarding plan for existing users. Additionally, they can define the scope of the data migration project and how it aligns with their business objective.
3. Migration budget and time estimation
   This Eagle feature accurately estimates the budget and duration of data migration by analyzing:
   • Volumetrics, data workloads, and data models (for the duration)Cloud migration and consumption data (for the cost)
4. Data lineage
   Data lineage enables organizations to unlock use cases in data governance, data privacy, and cloud computing. Some of its in-built features include code lineage, data lineage in table and column format, and end-to-end visibility into data flow.

Raven – The Transformer

Here are some of the core features of the Raven tool:

1. SQL code conversion
   With the Raven tool, organizations can automatically translate complex SQL codes and scripts. It also provides smart emulations for unsupported (or incomplete) SQL clauses using an SQL-like language. Among other capabilities, it can convert embedded SQL and incomplete SQL statements, along with parameterized SQL code.
   
   This feature also supports translation for database utilities like Bteq, Load-Store, and Macros. It has built-in support for DDL definitions for objects like stored procedures, macros, and view definitions.

2. ELT/ETL conversion
   With this feature, organizations can convert ETL to ELT scripts according to the target cloud environment. Additionally, Eagle supports custom expressions written in ETL code. It is also capable of converting non-SQL components that are part of ETL workflows.

3. Code optimization
   With Eagle’s code optimization feature, companies can achieve consistent optimization in generated code and scripts. They can benefit from cost and time savings due to SQL support and workflow optimization. During code transformation, this feature considers the data lineage and removes job redundancy.

Pelican – The Validator

Here are some of the core features of the Pelican validator tool:

1. AI-powered automated data validation and reconciliation with
   • AI-powered mapping engine and Soundex algorithm for initial setup
   • Expression engine for system configuration
   • Execution engine for data validation
2. Zero coding functionality – based on a no-code/ low-code development approach
3. No data movement (or duplication) across data sources during validation
4. End-to-end data validation comprising of
   • Cell-level validation
   • Metadata validation
   • Various validation modes

5. Data validation runs parallel to the data migration process – thus eliminating wait time for completion of the migration process.
6. Data lineage-powered triaging that
   • Validates all data load pipeline tables at the same time.
   • Traverses the entire lineage of data load pipelines and identifies the root cause of any data error.

7. Built-in reporting comprising
   • Summary dashboards.
   • Data validation reports.
   • Sample reports of data mismatch
   • Mismatch viewer that displays the text, hex, and the Unicode

8. Enterprise-wide data validation tool with
   • AES 256 encryption for data persistence.
   • Compatibility with SSL and TLS network standards.
   • Automated backups of metadata.
   • Work segmentation.

9. Integration with CI/CD pipelines with the ability to Automatically create mappings on multiple tables. Upload CSV files to quickly establish equivalence between renamed tables and table columns.
   • Automatically create mappings on multiple tables.
   • Upload CSV files to quickly establish equivalence between renamed tables and table columns.

In summary

By using the data migration suite of products from the Datametica Birds, organizations can accelerate their cloud migration initiatives. With the Datametica acquisition, Onix has empowered its customers to streamline data migration to Google Cloud – with improved speed and lower costs.

Besides, organizations can accelerate their cloud migration without any human intervention – and reduce the time and cost of migration by 50%. Here’s a case study of a U.S.-based retailer who leveraged the Pelican tool to save 90% of their data validation costs when migrating to Google Cloud.

Are you interested in knowing more about our data migration product suite? Just get in touch with us!