[SVLUG-Jobs] Senior Systems Engineer, Grid Services, Yahoo (and other grid positions)

[Greg Roelofs]

[posting this on behalf of hiring manager, Marco Nicosia, who's not me ;-) ]

Yahoo!'s Grid Computing Team is Hiring!

Started in early 2006 with just four people, the team is now over 35
people. The project is growing as fast as we can locate and hire people,
both in the SF Bay Area and in Bangalore, India.

Yahoo! is using, and is the largest contributor to, the open source
project, Hadoop. It is the base technology supporting our grid computing
initiative. Hadoop provides a distributed file system layer and a
map-reduce programming model. It allows our researchers and developers
to perform experiments across gigantic (terabytes to petabytes) datasets
on a shared infrastructure which benefits all Yahoo! users.

There are currently five positions listed here, with another couple likely
to show up shortly:

	http://escape.org/~marco/yahoo/

And yes, we know it's a tad unusual to use a personal web site for this,
but http://developer.yahoo.com/hadoop/ isn't enabled just yet. :-/


Here's the job description for the req listed in the subject line:

Systems Engineer, Grid Services, Senior
Requisition ID 	6190
Location 	Sunnyvale, CA  [headquarters; Santa Clara (below) is correct]
Description 	Position: Senior Systems Engineer, Grid Services
                Location: Santa Clara, Ca.

The Internet is a big, busy place, and we at Yahoo! are proud to stand out in the crowd. As the world's number one Internet brand, servicing over a half billion people, we're determined to maintain our commitment to delivering news, entertainment, information and fun... each and every day.

In order to maintain our position as one of the world's most trafficked Internet destinations, we're always on the lookout for people with big ideas and big talent to help us provide our visitors with the innovative products and services they've come to expect from Yahoo!. We're looking for people like you.

How Big Can You Think?

Yahoo! Grid Services is searching for a qualified Systems Engineer to monitor and maintain our grid (utility computing) clusters. Each cluster is thousands of nodes with petabytes of high-value data, running a distributed file system, map-reduce processing framework, and scheduling software. We provision these shared resources for the use of researchers and engineers who are working to improve the quality of Yahoo! Search and Advertising.

You will be consulting with Yahoo! researchers, assisting them in their work, collecting and driving their enhancement requirements.

The primary computing platform is Hadoop, an Apache Software Foundation open source project for massively scalable utility computing. Yahoo! is a major contributor to Hadoop and related projects. You will have the opportunity to work with a significant open source project that will be adopted by some of the largest software and Internet companies in the world.

The Grid team combines powerful open source packages, including Hadoop, a huge quantity of compute and storage resources, petabytes of data from a variety of sources, and support services to provide a utility computing service platform for the company. We are enabling Yahoo! engineers and scientists to perform data analysis on a vast scale, giving us the insights we need to improve Yahoo! Search, advertising, and other properties.

Responsibilities
* Based on operational and project guidelines, work with independence and discretion regarding how to carry out tasks.
* Take initiative to improve processes and help to plan for the future of the service.
* Manage the work of novice system administrators or operators.
* Evaluate and/or recommend purchases and have a strong influence on the purchasing process.
* Monitor cluster health and performance, use critical thinking to find areas for improvement.
* Invent better ways to manage the existing clusters, via scripting and tools development.
* Hardware and facility capacity planning, provisioning new resources.
* Application profiling and performance analysis.
* Real-time problem diagnosis/resolution on live systems.
* Data load monitoring.
* Systems monitoring and alerting.
* Participate in a group pager rotation for emergencies, primary response for the user support queue.
* Devise schemes to transfer terabytes of data from diverse locations securely and reliably.
* Reporting (html, e-mail, etc).
* Resolve all operation issues, escalating engineering defects to the development organization.
* Documentation on the running systems and their associated configurations.

Minimum Job Qualifications


* Experience as a Unix systems engineer in an internet related business.
* Strong shell scripting skills in at least one of awk, perl, or python.
* Strong interpersonal and communication skills; capable of explaining simple procedures in writing or verbally; good phone skills.

Preferred Job Qualifications

* BS or MS in Computer Science (or equivalent).
* Minimum 2 years experience as a Unix systems engineer with at least 1 year in an internet related business.
* Knowledge and work experience with Java and Java profilers.
* Cluster computing platforms like Condor, Torque, Maui / Moab, Sun Grid Engine.
* Experience with programming models for large clusters: MPI, PVM, etc.

Yahoo! Inc. is an equal opportunity employer. For more information or to search all of our openings, please visit http://careers.yahoo.com



Cheers,
-- 
Greg Roelofs          newt at pobox.com           http://pobox.com/~newt/
Newtware, PNG Group, AlphaWorld Map, Yahoo! Search, ...