Senior Data Engineer (Python, Scala, or Spark)
Are you an experienced data engineer with a passion for utilizing cutting-edge technologies to drive innovation? Do you thrive in a fast-paced and collaborative environment? Look no further – Capital One is seeking a highly skilled Senior Data Engineer with expertise in Python, Scala, or Spark to join our dynamic team. In this role, you will have the opportunity to leverage your technical skills to build and maintain robust data pipelines, enabling data-driven decision making across the organization. We are seeking a driven and self-motivated individual with a strong foundation in data engineering principles and a desire to continuously learn and grow. If you are ready to take on a new challenge and make an impact at a leading financial institution, we want to hear from you!
- Design and implement data pipelines using Python, Scala, or Spark to extract, transform, and load large datasets from various sources.
- Collaborate with cross-functional teams to understand business needs and translate them into technical requirements for data solutions.
- Utilize cutting-edge technologies to drive innovation and improve the efficiency and scalability of data pipelines.
- Develop and maintain data warehousing and data modeling strategies to support data-driven decision making.
- Troubleshoot and optimize data pipelines to ensure high quality, reliable, and timely data delivery.
- Stay current with industry trends and best practices in data engineering to continuously improve processes and systems.
- Mentor and provide technical guidance to junior data engineers on best practices and coding standards.
- Work closely with data scientists and analysts to understand their data needs and provide support for data access and manipulation.
- Identify and implement opportunities for automation and optimization of data processes.
- Collaborate with data governance and security teams to ensure compliance with data privacy and security regulations.
- Communicate effectively with stakeholders at all levels to provide updates on project status and data engineering initiatives.
- Take ownership of data engineering projects and drive them to successful completion within tight deadlines.
- Continuously monitor and improve the performance and reliability of data pipelines.
- Maintain documentation and version control for data pipelines and related processes.
- Participate in agile development processes and contribute to team discussions and decision-making.
Extensive Experience With Python, Scala, Or Spark: A Senior Data Engineer At Capital One Must Have A Strong Background And Experience In One Or More Of These Languages. They Should Be Able To Write Efficient And Scalable Code To Process And Analyze Large Datasets.
In-Depth Knowledge Of Data Engineering Principles: A Senior Data Engineer Should Have A Deep Understanding Of Data Engineering Principles Such As Data Modeling, Data Warehousing, And Etl Processes. They Should Also Be Familiar With Various Data Storage And Processing Technologies.
Strong Problem-Solving Skills: As A Senior Data Engineer, One Must Be Able To Identify And Troubleshoot Complex Data-Related Issues. They Should Have A Strong Analytical Mindset And Be Able To Think Critically To Find Solutions To Data Engineering Problems.
Experience With Cloud-Based Data Platforms: Capital One Utilizes Cloud-Based Data Platforms Such As Aws And Azure For Their Data Infrastructure. A Senior Data Engineer Should Have Experience Working With These Platforms And Be Familiar With Their Tools And Services.
Leadership And Communication Skills: As A Senior Member Of The Data Engineering Team, A Senior Data Engineer Is Expected To Provide Technical Guidance And Mentorship To Junior Engineers. They Should Also Possess Excellent Communication Skills To Effectively Collaborate With Cross-Functional Teams And Present Their Ideas To Stakeholders.
Business Intelligence
Database Management
Data Modeling
Machine Learning
Data warehousing
Data Visualization
Cloud Computing
Data Mining
Data Analytics
ETL processes
Data architecture
Communication
Conflict Resolution
Emotional Intelligence
Leadership
Time management
creativity
Attention to detail
Teamwork
Adaptability
Problem-Solving
According to JobzMall, the average salary range for a Senior Data Engineer (Python, Scala, or Spark) in San Francisco, CA, USA is $150,000 - $200,000 per year. This can vary depending on the specific company, industry, and level of experience.
Apply with Video Cover Letter Add a warm greeting to your application and stand out!
Capital One Financial Corporation is an American bank holding company specializing in credit cards, auto loans, banking, and savings accounts, headquartered in McLean, Virginia. Capital One is ranked 11th on the list of largest banks in the United States by assets.
Get interviewed today!
JobzMall is the world‘ s largest video talent marketplace.It‘s ultrafast, fun, and human.
Get Started