Senior Data Engineer (Spark, BigData Hadoop)
At Visa, we strive to be at the forefront of technology and innovation, constantly pushing the boundaries to provide the best payment solutions for our customers. As a Senior Data Engineer with expertise in Spark and BigData Hadoop, you will play a crucial role in shaping the future of our data infrastructure. We are looking for a highly skilled and motivated individual to join our dynamic team and help us drive data-driven decision making at Visa. If you have a passion for cutting-edge technology and a strong background in data engineering, read on to learn more about this exciting opportunity.
- Design and develop scalable and efficient data pipelines using Spark and BigData Hadoop technologies.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Implement data models and data structures to support data analytics and reporting.
- Optimize data processing and storage for performance and cost efficiency.
- Troubleshoot and resolve complex data issues in a timely manner.
- Develop and maintain data documentation, including data dictionaries, data lineage, and data flow diagrams.
- Stay current with emerging technologies and industry trends, and make recommendations for improving data engineering processes and tools.
- Mentor and guide junior data engineers in best practices and coding standards.
- Work closely with data scientists to support their analytical needs and help them leverage data for insights and decision-making.
- Participate in code reviews and provide constructive feedback to ensure high-quality deliverables.
- Collaborate with other senior engineers to evaluate and implement new technologies and processes.
- Ensure data security and compliance with relevant regulations and policies.
- Maintain a deep understanding of Visa's data landscape and contribute to its evolution and improvement.
Extensive Experience In Spark And Bigdata Hadoop: A Senior Data Engineer At Visa Should Have A Strong Background In Both Spark And Bigdata Hadoop, Including Hands-On Experience With Developing And Optimizing Data Pipelines, Data Ingestion, And Data Processing.
Proficiency In Programming Languages: The Ideal Candidate Should Possess Advanced Programming Skills In Languages Like Java, Scala, And Python, As Well As Experience With Tools Like Hive, Pig, And Spark Sql For Data Manipulation And Analysis.
Strong Knowledge Of Data Warehousing And Etl Processes: A Senior Data Engineer Should Have A Deep Understanding Of Data Warehousing Concepts And Be Able To Design And Implement Efficient Etl Processes To Support Data Analytics And Reporting.
Experience With Cloud-Based Data Platforms: With Visa Moving Towards A Cloud-Based Environment, The Candidate Should Have Experience With Cloud-Based Data Platforms Such As Aws Or Azure, And Be Able To Design And Implement Scalable And Reliable Data Solutions.
Excellent Problem-Solving And Communication Skills: The Role Of A Senior Data Engineer At Visa Involves Working With Cross-Functional Teams To Identify And Solve Complex Data Challenges. The Candidate Should Have Excellent Problem-Solving Abilities And Be Able To Communicate Effectively With Technical And Non-Technical Stakeholders.
Data Modeling
Data warehousing
Data Visualization
Cloud Computing
Hadoop ecosystem
Big data processing
Data integration
ETL Development
Data architecture
SQL querying
Spark Programming
Communication
Conflict Resolution
Emotional Intelligence
Leadership
Time management
Interpersonal Skills
creativity
Teamwork
Adaptability
Problem-Solving
According to JobzMall, the average salary range for a Senior Data Engineer (Spark, BigData Hadoop) in Bengaluru, Karnataka, India is between ₹ 12,00,000 - ₹ 22,00,000 per year, depending on the company, experience level, and skills of the individual. This equates to approximately $16,000 - $29,000 USD per year.
Apply with Video Cover Letter Add a warm greeting to your application and stand out!
Visa Inc. is an American multinational financial services corporation headquartered in Foster City, California, United States. It facilitates electronic funds transfers throughout the world, most commonly through Visa-branded credit cards, debit cards and prepaid cards.
Get interviewed today!
JobzMall is the world‘ s largest video talent marketplace.It‘s ultrafast, fun, and human.
Get Started