Data Engineer-Data Integration

About the position Responsibilities • Develop, maintain, evaluate, and test big data solutions. • Create pipelines/workflows for Source to Target and implement solutions that tackle the client's needs. • Design, build, optimize and support new and existing data models and ETL processes based on our client's business requirements. • Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. • Coordinate data access and security to enable data scientists and analysts to easily access data whenever they need to. Requirements • Bachelor's Degree • Design, develop, and maintain Ab Initio graphs for extracting, transforming, and loading (ETL) data from diverse sources to various target systems. • Implement data quality and validation processes within Ab Initio. • Collaborate with data architects and business analysts to understand data requirements and translate them into effective ETL processes. • Analyse and model data to ensure optimal ETL design and performance. • Utilize Ab Initio components such as Transform Functions, Rollup, Join, Normalize, and others to build scalable and efficient data integration solutions. • Implement best practices for reusable Ab Initio components. Nice-to-haves • Master's Degree • Optimize Ab Initio graphs for performance, ensuring efficient data processing and minimal resource utilization. • Conduct performance tuning and troubleshooting as needed. • Work closely with cross-functional teams, including data analysts, database administrators, and quality assurance, to ensure seamless integration of ETL processes. • Participate in design reviews and provide technical expertise to enhance overall solution quality. Apply tot his job Apply To this Job