Engaged in the ICBC RAAP (Rate Affordability Action Plan) initiative, contributing to the transformation of the existing vehicle-based insurance model into an individual driver-based system. The aim was to provide the citizens of British Columbia with a fair and personalized insurance rate model.
- Developed data pipelines within the Hadoop-based Enterprise Data Warehouse, focusing on provincial contravention data. This supported the implementation of the revised insurance model, offering enhanced insights for the provincial Road Safety Initiative.
- Executed Data Management, Data Modeling, Data Analysis, and Information Visualization (Tableau) to optimize data-driven decision-making processes.
- Collaborated with a seasoned team of Senior Data Engineers and Architect Owners, adhering to a disciplined agile methodology for development.
- Utilized a diverse technology stack, including Hadoop, YARN, Apache Spark, Scala, MapR DB, Parquet FS, NoSQL, and RDBMS (Oracle, DB2, MySQL, PostgresSQL, MS SQL Server). Conducted unit testing and integration testing of data pipelines to ensure robust and reliable data processing.