vishwa management services Looking for AVP – Lead Data Engineer – IT Deptt – Top Life Insurance Co. at Mumbai, Maharashtra Full Time

Job Description

Roles and Responsibilities

• Assist in the development of Data warehouse and Data Integration roadmap inline with business plan,Develop models and structure changes needed to meet the evolving software and data platform strategies,Formulates the strategy and direction for the requirements process across projects, Develop/Design Data ingestion pipelines as part of data integration ,cleaning and processing, Develop efficient software code for multiple use cases leveraging Python and Big Data technologies for various use cases built on the AWS cloud platform, Provide high operational excellence guaranteeing high availability and platform stability, Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Pyspark, Kafka, any Cloud computing etc.

Anticipate and resolve complex problems that impact data design.

• Assist in critical technical and design decisions during the development process

Manage the budget expenditure and allocation across teams and projects, propose new operational plans, including targeted budgets, work allocations and staff forecasts Monitor and track the team’s achievements and key performance indicators

Develop learning roadmaps to support the professional development of the team

• Develop and established detailed governance mechanism for robustness of Data Pipeline with respect to schemas, distributions and data completeness and its aligned with stakeholder requirements
• Establish the baselines for the time required for data to be available for analysis by evaluating the system feasibility and operational governance
• Establish broad standards for augmenting and optimizing metrices for data capabilities based on system readiness and for evaluation of functional domain Eg. Velocity, Veracity, Query to report conversion rate and optimal time needed for data to be reported in form of KPIs etc.
• Identify issues in codes or bugs that have entered the production stage, Drive performance optimization by developing optimized codes (data pipeline) for efficient resource utilization, Ensure compliance to release deadlines as per stakeholder(both internal and external) timelines, Design scalable infrastructure to enhance quality, efficiency and competitiveness.

Desired Candidate Profile

1. Candidate must have Bachelor’s degree in Computer Science, Software Engineering / IT / any related technical discipline

2. Knowledge of any of the programming languages: Python, Scala or Java

3. Primary Skill: Strong Knowledge on SQL , Dimensional Modelling, Pysprk ,AWS Glue , AWS DMS , ETL tools like Pentaho , Data stage etc., Big data technologies, Data Integration using API .

4. working directly with Data engineering teams, Experience in Datawarehouse, Data Ingestion and Dimensional Modeling technique,

5. Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules, Experience driving technical strategy and architecture decisions especially for mid to large scale projects,

6. Experience in working on large cross org programs with extensive technical deep dive skills, Experience with Distributed Versioning Control environments such as GIT, Demonstrated experience in modern API platform design including how modern UI s are built consuming services / APIs,

7. Experience on AWS cloud including AWS DMS, Glue, Athena, EMR, Databricks is highly preferred

Role:Data Engineer

Salary: 32,50,000 – 37,50,000 P.A.

Industry:IT Services & Consulting

Department:Data Science & Analytics

Role Category:Data Science & Machine Learning

Employment Type:Full Time, Permanent

Key Skills

Data IngestionOracle SQLData engineeringNoSQLSQL TuningDatastageSnowflakeData EngineerData ModelingAWSPythonData ValidationJavaScalaHadoopEMRApacheAWS DMSETL ToolHiveGlueDatawarehouseSparkDatabricksETLAthenaPentahoAWS cloud

Education

UG:B.Tech/B.E. in Computers

PG:MS/M.Sc(Science) in Data Informatics, Computers

Company Profile

Vishwa Management Services

VISHWA Management Services is a Leading Recruitment Consultancy Firm Is Into Executive Search & Selection, Human Resource And Placement Consultancy Business. We Are Based Out Of INDORE And Serving The Nationwide and Overseas.

VISHWA Management Services, Offers Total Recruitment Services For Both Employers As Well As Employees. We Have Expertise In Non-IT And IT, ITES Recruitment. We Are Mainly Focused Into FMCG, Banking, Insurance, NBFC, Cement & Construction Material, Automobile, Pharma, Consumer Durable, Retail, IT, ITES, BPO/KPO, Life Sciences & Biotech Research.

X