Senior Engineer- Big Data (Hadoop, Pyspark, Hive)
Are you a seasoned engineer with a passion for Big Data and cutting-edge technologies? Do you thrive in a fast-paced, dynamic environment where you can make a significant impact? Look no further! American Express is seeking a highly skilled and experienced Senior Engineer to join our Big Data team and help us drive innovation and success. As a Senior Engineer, you will have the opportunity to work with a talented and collaborative team, utilizing your expertise in Hadoop, Pyspark, and Hive to design, develop, and implement solutions that will shape the future of our company. We are looking for someone who is not only technically proficient, but also a strong communicator and strategic thinker. If this sounds like you, we encourage you to apply for this exciting and rewarding opportunity.
- Design and develop scalable and efficient Big Data solutions using Hadoop, Pyspark, and Hive.
- Collaborate with cross-functional teams to identify business needs and translate them into technical requirements.
- Contribute to the architectural design and development of Big Data systems.
- Stay up-to-date with the latest technologies and trends in the Big Data space, and make recommendations for their implementation.
- Troubleshoot and resolve any performance or reliability issues with the Big Data infrastructure.
- Communicate complex technical concepts to non-technical stakeholders in a clear and concise manner.
- Mentor and guide junior team members, providing technical leadership and fostering a culture of continuous learning.
- Take ownership of projects and drive them to successful completion, meeting deadlines and adhering to quality standards.
- Conduct code reviews and ensure compliance with coding best practices and standards.
- Collaborate with external vendors and partners to integrate their solutions with our Big Data systems.
- Identify and implement process improvements to optimize data ingestion, processing, and storage.
- Participate in on-call rotations and provide support for production systems as needed.
- Keep accurate documentation of designs, processes, and system configurations.
- Proactively identify and mitigate risks in the Big Data systems.
- Maintain a strong understanding of the company's business goals and align technical solutions accordingly.
Extensive Experience With Hadoop, Pyspark, And Hive: The Ideal Candidate Should Have A Strong Background In Hadoop, Pyspark, And Hive Technologies, With A Deep Understanding Of Their Capabilities And Use Cases.
Strong Problem-Solving And Analytical Skills: A Senior Engineer In Big Data At American Express Will Be Responsible For Developing Complex Solutions To Business Problems. Therefore, The Candidate Should Possess Excellent Problem-Solving And Analytical Skills To Identify And Address Technical Challenges.
In-Depth Knowledge Of Data Management And Processing: The Role Requires A Deep Understanding Of Data Management And Processing Techniques, Including Data Ingestion, Transformation, And Analysis. The Candidate Should Also Have Experience In Handling Large Datasets And Implementing Data Governance Practices.
Leadership And Project Management Skills: As A Senior Engineer, The Candidate Will Be Expected To Lead And Manage Projects, Collaborate With Cross-Functional Teams, And Mentor Junior Team Members. Strong Leadership And Project Management Skills Are Essential For Success In This Role.
Excellent Communication And Collaboration Skills: The Candidate Should Have Excellent Communication Skills To Effectively Communicate Technical Concepts To Both Technical And Non-Technical Stakeholders. They Should Also Be Able To Collaborate With Business Partners To Understand Their Requirements And Translate Them Into Technical Solutions.
Data Analysis
Data Modeling
Machine Learning
Data warehousing
Hadoop development
Big Data Architecture
ETL (Extract, Transform, Load)
Pyspark Programming
Hive Querying
Communication
Emotional Intelligence
Leadership
Time management
Interpersonal Skills
Organization
Critical thinking
Teamwork
Adaptability
Problem-Solving
According to JobzMall, the average salary range for a Senior Engineer- Big Data (Hadoop, Pyspark, Hive) in Gurugram, Haryana, India is between ₹1,500,000 to ₹3,000,000 per year. This salary range can vary depending on factors such as company size, industry, experience level, and skills. Some companies may offer higher salaries for candidates with advanced skills and experience in big data technologies. Additionally, candidates who have a strong track record of delivering successful big data projects may also be able to negotiate a higher salary.
Apply with Video Cover Letter Add a warm greeting to your application and stand out!
American Express Co. operates as a global services company, which engages in the provision of credit card, financial, and global travel services. It operates through the following business segments: U.S. Card Services, International Card Services, Global Commercial Services, Global Network & Merchant Services, and Corporate.
Get interviewed today!
JobzMall is the world‘ s largest video talent marketplace.It‘s ultrafast, fun, and human.
Get Started