Challenges
- Difficulty in scaling as per dynamic streaming data volume
- Longer release cycle for implementing unstructured data changes
- High maintenance of solution
Solutions
- Provided framework, migration plan from Hive to Snowflake
- Configured incremental import of unstructured device data into Snowflake
- Developed dynamic views in Snowflake to quickly accommodate unstructured data changes
- Created materialized views for frequently used data queries in Tableau
Benefits
- Significant performance gain
- Minimal administration requirements
- Seamless resource scaling
US based computer networking hardware provider
The problem encompasses the struggle to adapt to fluctuating streaming data volumes, prolonged release cycles for integrating unstructured data changes, and the burdensome maintenance of their existing solution.
