Senior Data Engineer (Python, Scala, or Spark)
Welcome to Capital One! We are seeking a highly skilled Senior Data Engineer with expertise in Python, Scala, or Spark to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing and building data pipelines to support our rapidly growing business. Your contributions will directly impact our ability to make data-driven decisions and drive innovation. We are looking for candidates who are passionate about data, have a strong understanding of big data technologies, and possess a deep knowledge of Python, Scala, or Spark. If you thrive in a collaborative and fast-paced environment and are eager to make a meaningful impact, we encourage you to apply for this exciting opportunity.
- Design and build data pipelines to support the company's growing business needs.
- Utilize expertise in Python, Scala, or Spark to develop efficient and scalable data solutions.
- Collaborate with cross-functional teams, including data scientists and analysts, to understand business requirements and translate them into technical solutions.
- Continuously optimize and improve existing data processes to ensure high-quality and reliable data.
- Stay up-to-date with emerging technologies and best practices in big data and data engineering.
- Take ownership of data infrastructure and ensure its stability, performance, and security.
- Troubleshoot and resolve any data pipeline issues in a timely manner to minimize business disruptions.
- Provide technical guidance and mentorship to junior data engineers.
- Communicate complex technical concepts and solutions to non-technical stakeholders.
- Contribute to the development and maintenance of data engineering standards, policies, and procedures.
- Collaborate with other teams to identify and implement opportunities for automation and efficiency.
- Participate in code reviews and ensure adherence to coding standards and best practices.
- Act as a subject matter expert for data-related topics and provide guidance to other teams as needed.
- Drive innovation and help shape the future of data engineering at Capital One.
- Embrace a collaborative and fast-paced work environment and contribute to a positive team culture.
Extensive Experience With Python, Scala, Or Spark: The Senior Data Engineer Should Have A Deep Understanding And Proficiency In At Least One Of These Programming Languages, With A Strong Command Over Its Libraries And Frameworks.
Strong Knowledge Of Data Architecture And Modeling: The Candidate Should Possess A Strong Understanding Of Data Architecture Principles And Best Practices, Along With Expertise In Data Modeling Techniques To Design Efficient And Scalable Data Pipelines.
Experience With Big Data Technologies: A Senior Data Engineer At Capital One Should Have Hands-On Experience With Big Data Technologies Such As Hadoop, Spark, Or Nosql Databases, Along With A Good Understanding Of Their Underlying Concepts And How To Leverage Them For Data Processing.
Proven Track Record Of Building And Maintaining Data Pipelines: The Ideal Candidate Should Have A Proven Track Record Of Designing, Building, And Maintaining Complex Data Pipelines On Large-Scale Data Sets, Along With Experience In Optimizing Data Workflows For Performance And Scalability.
Strong Analytical And Problem-Solving Skills: As A Senior Data Engineer, The Candidate Will Be Responsible For Identifying And Solving Complex Data-Related Problems, Therefore, They Should Possess Strong Analytical Skills And Be Able To Think Critically To Develop Innovative Solutions.
Data Analysis
Database Management
Data Modeling
Machine Learning
Data warehousing
Cloud Computing
Big data processing
Data integration
Scripting languages
Data governance
ETL Development
Communication
Conflict Resolution
Customer Service
Emotional Intelligence
Leadership
Time management
creativity
Teamwork
Adaptability
Problem-Solving
According to JobzMall, the average salary range for a Senior Data Engineer (Python, Scala, or Spark) in New York, NY, USA is $120,000 - $180,000 per year. However, this can vary depending on factors such as experience, skills, and the specific company or industry. Some data engineers with more advanced skills or working in high-demand industries may earn even higher salaries.
Apply with Video Cover Letter Add a warm greeting to your application and stand out!
Capital One Financial Corporation is an American bank holding company specializing in credit cards, auto loans, banking, and savings accounts, headquartered in McLean, Virginia. Capital One is ranked 11th on the list of largest banks in the United States by assets.
Get interviewed today!
JobzMall is the world‘ s largest video talent marketplace.It‘s ultrafast, fun, and human.
Get Started