The Challenge
- Performance issues: The customer was experiencing performance issues with the latency and throughput of IoT telemetry data, which was slow to reach target systems to enable real-time analytics and support better decision making for supply chain efficiency.
- Infrastructure costs: The customer was paying too much for the data warehouse infrastructure due to the non-optimal design of the data warehouse layers, including the staging area and data enrichment process.
Problems to solve
- Data analysis problems: The customer faced problems analyzing data using dashboards. Due to non-optimal architectural decisions, the underlying time series database was not able to retrieve the results for the required reports in the desired time. This led to a lack of confidence in the use of dashboards by data analysts.
The solution
A team of two architects from C&F was assigned to analyze and optimize client issues. They provided a consistent evaluation and a set of recommendations in the following areas:
- Technical/Product
- Data
- Infrastructure/FinOps
- Performance tuning of the used technologies
Results
- Quick wins: A list of quick wins has been identified for each data product and infrastructure to address performance, cost optimization and process improvements.
IOT data collection performance tuning