Large Financial Organization
Our client struggled with keeping a huge amount of IT systems under control. Complex IT Architecture leads to high operating costs and poor quality of IT services. The key purposes of the project were:
- To provide real-time anomaly detection for log data
- To optimize HelpDesk ticket routing process
- To evaluate systems efficiency and the associated potentials
A flexible solution based on Lambda architecture was suggested. This approach allowed for high scalability and reliability of the system. The implemented system has a modular architecture and can be extended on a per-feature basis.
The provided solution allowed a 5% reduction of average time-to-solve for HelpDesk tickets. Inefficient IT systems were identified and their replacement was scheduled. Over 15 mln log records are being analyzed every day.
Technology Set: BigInsights, Spark, Scala, Hive, Hbase, Lambda architecture, Speed layer, Batch layer, Serving layer