Lead Software Engineer (Lead ETL PySpark Developer)
Welcome to ProQuest! We are looking for a highly skilled and motivated Lead Software Engineer to join our team and lead our ETL PySpark development efforts. As a lead developer, you will have the opportunity to work on cutting-edge technology and help shape our data processing and analysis strategies. We are seeking an individual who is passionate about software engineering and has a strong background in ETL processes and PySpark development. If you are a driven and innovative individual with the necessary qualifications, we would love to hear from you. Join us in our mission to provide valuable data solutions to our clients and make a significant impact in the world of data analytics.
- Lead and oversee all aspects of ETL PySpark development for the company
- Design and implement efficient and scalable data processing and analysis strategies
- Collaborate with cross-functional teams to understand business needs and translate them into technical solutions
- Mentor and guide junior members of the development team
- Stay updated on latest trends and advancements in ETL and PySpark technology
- Troubleshoot and resolve technical issues as they arise
- Conduct regular code reviews to ensure quality and maintain coding standards
- Develop and maintain documentation for all ETL processes and systems
- Collaborate with data scientists and data analysts to ensure accurate and efficient data processing
- Work closely with project managers to ensure timely delivery of projects
- Participate in regular team meetings and provide updates on project status and progress
- Continuously improve and optimize existing ETL processes to ensure high performance and efficiency
- Communicate effectively with team members and stakeholders to provide status updates and address any concerns or issues.
Extensive Experience With Etl Development: The Lead Software Engineer At Proquest Must Have A Deep Understanding Of Etl Processes And A Proven Track Record Of Successfully Developing Etl Solutions. They Should Be Proficient In Using Tools Such As Pyspark To Extract, Transform, And Load Data Into Data Warehouses.
Strong Programming Skills: As A Lead Software Engineer, The Candidate Should Possess Strong Programming Skills In Languages Such As Python, Sql, And Java. They Should Be Able To Write Efficient, Scalable, And Maintainable Code For Data Pipelines And Data Manipulation.
Leadership And Team Management Experience: Proquest Is Looking For A Candidate Who Has Experience Leading And Managing A Team Of Software Engineers. The Lead Software Engineer Will Be Responsible For Guiding And Mentoring Junior Team Members, Delegating Tasks, And Ensuring Timely Delivery Of Projects.
Familiarity With Big Data Technologies: In Addition To Etl Development, The Ideal Candidate Should Have Experience Working With Big Data Technologies Such As Hadoop, Spark, And Kafka. They Should Be Able To Leverage These Technologies To Design And Build Robust Data Pipelines.
Strong Problem-Solving And Analytical Skills: The Lead Software Engineer Should Have A Keen Eye For Detail And Possess Strong Problem-Solving And Analytical Skills. They Should Be Able To Identify And Troubleshoot Issues In Data Pipelines, As Well As Propose And Implement Solutions To Improve Overall System Performance.
Project Management
Troubleshooting
Data Analysis
Database Management
Data Modeling
Performance optimization
Code Review
Team Leadership
Agile methodologies
ETL Development
Pyspark Programming
Communication
Conflict Resolution
Emotional Intelligence
Leadership
Time management
creativity
flexibility
Teamwork
Adaptability
Problem-Solving
According to JobzMall, the average salary range for a Lead Software Engineer (Lead ETL PySpark Developer) in Karnataka, India is between ₹1,200,000 and ₹2,500,000 per year. This equates to roughly $16,000 to $33,000 USD per year. This salary range can vary depending on the company, location, and level of experience of the individual.
Apply with Video Cover Letter Add a warm greeting to your application and stand out!
ProQuest LLC is an Ann Arbor, Michigan-based global information-content and technology company, founded in 1938 as University Microfilms by Eugene B. Power. ProQuest provides applications and products for libraries.
Get interviewed today!
JobzMall is the world‘ s largest video talent marketplace.It‘s ultrafast, fun, and human.
Get Started