Senior Databricks Data Engineer
Are you a highly experienced Data Engineer looking for a challenging new opportunity? State Street is seeking a Senior Databricks Data Engineer to join our dynamic and innovative team. In this role, you will use your expertise in Databricks to design, develop, and maintain data pipelines and solutions for our global financial services organization. We are looking for a driven and collaborative individual who is passionate about data and has a strong understanding of cloud-based architectures and technologies. If you have a proven track record of delivering complex data projects and thrive in a fast-paced environment, we want to hear from you!
- Design and develop complex data pipelines and solutions using Databricks for our global financial services organization.
- Maintain and optimize existing Databricks data pipelines to ensure efficient and accurate data processing.
- Collaborate with cross-functional teams to understand data requirements and design appropriate solutions.
- Utilize your expertise in Databricks to troubleshoot and resolve any issues that may arise in the data pipelines.
- Keep up-to-date with emerging trends and technologies in Databricks and cloud-based architectures to continuously improve our data processes.
- Work closely with business stakeholders to understand their data needs and provide timely and accurate data solutions.
- Ensure data quality and integrity by implementing appropriate data governance and security measures.
- Manage and prioritize multiple data projects, ensuring timely delivery and adherence to project deadlines.
- Mentor and provide guidance to junior data engineers on Databricks best practices and standards.
- Communicate effectively with team members, stakeholders, and management to provide updates on project progress and any potential challenges.
- Proactively identify and implement process improvements to enhance the efficiency and scalability of our data pipelines.
- Stay up-to-date on industry regulations and compliance standards relevant to financial services data.
- Participate in code reviews and contribute to the overall improvement of our data engineering practices.
- Collaborate with infrastructure and DevOps teams to ensure smooth deployment and operation of data pipelines.
- Continuously monitor and optimize the performance of Databricks data pipelines to meet business needs and SLAs.
Extensive Experience With Databricks: A Senior Databricks Data Engineer At State Street Should Possess A Deep Understanding Of Databricks, Including Its Architecture, Features, And Capabilities. They Should Have Experience Designing And Implementing Complex Data Pipelines And Workflows Using Databricks, As Well As Troubleshooting And Optimizing Performance Issues.
Strong Programming Skills: The Ideal Candidate Should Have A Strong Background In Programming Languages Commonly Used In Data Engineering, Such As Python, Scala, And Sql. They Should Be Able To Write Efficient And Maintainable Code, As Well As Have Experience With Version Control Systems Like Git.
Data Management And Warehousing Expertise: Senior Databricks Data Engineers At State Street Should Have A Strong Understanding Of Data Management Principles And Best Practices. This Includes Experience With Data Warehousing Concepts And Tools, Such As Snowflake, As Well As Experience With Data Modeling And Database Design.
Cloud Computing Experience: State Street's Data Engineering Team Utilizes Cloud Computing Platforms Such As Aws And Azure. The Ideal Candidate Should Have Experience Working With These Platforms, Including Knowledge Of Cloud-Based Data Storage Solutions And Experience With Deploying And Managing Data Pipelines In The Cloud.
Communication And Collaboration Skills: A Senior Databricks Data Engineer Should Be Able To Effectively Communicate Complex Technical Concepts To Both Technical And Non-Technical Stakeholders. They Should Also Have Experience Working In A Collaborative Team Environment, As Well As The Ability To Mentor And Guide Junior Team Members.
SQL Programming
Data Modeling
Machine Learning
Data warehousing
Cloud Computing
Data governance
ETL Development
Data architecture
Big Data Analytics
Data pipeline management
Spark Development
Communication
Conflict Resolution
Emotional Intelligence
Leadership
Time management
creativity
Teamwork
Active Listening
Adaptability
Problem-Solving
According to JobzMall, the average salary range for a Senior Databricks Data Engineer in Quincy, MA, USA is $150,000 - $180,000 per year. This range can vary depending on factors such as the specific company, the candidate's level of experience, and the demand for data engineers in the area.
Apply with Video Cover Letter Add a warm greeting to your application and stand out!
State Street Corporation is an American financial services and bank holding company headquartered at One Lincoln Street in Boston with operations worldwide. It is the second-oldest continually operating United States bank; its predecessor, Union Bank, was founded in 1792.
Get interviewed today!
JobzMall is the world‘ s largest video talent marketplace.It‘s ultrafast, fun, and human.
Get Started