Lead Data Engineer (Spark, Scala, SQL)

Welcome to Capital One, where we believe in using cutting-edge technology to drive our business forward. We are currently seeking a highly skilled and motivated Lead Data Engineer who is well-versed in Spark, Scala, and SQL to join our growing team. In this role, you will have the opportunity to work with a talented group of individuals and lead the development and implementation of data-driven solutions. We are looking for someone who is passionate about data, thrives in a fast-paced environment, and has a strong understanding of data engineering principles. If you are ready to make a significant impact and drive innovation at one of the leading financial institutions, then we want to hear from you.

1. Develop and implement data-driven solutions using cutting-edge technology, including Spark, Scala, and SQL, to drive business growth and success.
2. Lead a team of data engineers and collaborate with cross-functional teams to design, build, and maintain data pipelines and infrastructure.
3. Work closely with business stakeholders to understand their data needs and provide strategic recommendations for data-driven solutions.
4. Design and maintain data models and data warehouses to ensure accurate and efficient data storage and retrieval.
5. Monitor and optimize data pipelines for performance, reliability, and scalability.
6. Stay updated with the latest advancements and trends in data engineering and propose new technologies and tools to improve our data processes.
7. Troubleshoot and resolve data-related issues in a timely manner.
8. Use data quality and governance best practices to maintain the integrity and security of our data.
9. Mentor and train junior data engineers and provide technical guidance and support.
10. Collaborate with the data science team to develop machine learning models and integrate them into data pipelines.
11. Create and maintain technical documentation for data processes and solutions.
12. Continuously evaluate and improve data engineering processes to increase efficiency and productivity.
13. Communicate project progress, issues, and risks to stakeholders and provide actionable solutions.
14. Adhere to industry standards and regulations for data storage and privacy.
15. Act as a subject matter expert for data engineering and provide thought leadership to drive innovation within the organization.

According to JobzMall, the average salary range for a Lead Data Engineer (Spark, Scala, SQL) in Atlanta, GA, USA is between $140,000 to $170,000 per year.

This range may vary depending on factors such as the candidate's level of experience, the company's size and industry, and the specific skills required for the role. Experienced and highly skilled Lead Data Engineers may be able to command a higher salary.

It is important to note that salaries may also include bonuses, benefits, and other forms of compensation, which can significantly impact the overall salary package.

Capital One Financial Corporation is an American bank holding company specializing in credit cards, auto loans, banking, and savings accounts, headquartered in McLean, Virginia. Capital One is ranked 11th on the list of largest banks in the United States by assets.