Monday, October 14, 2013

Help Us Design and Build an Open Source Google Omega

One key Cloud Foundry design goal is that a single operations person should be able to manage hundreds or thousands of machines. We want to bring to the similar tools that are available privately to web scale-out companies like Google with Omega to the typical enterprise. We are looking for a hands-on practitioner that is passionate about creating and operating large systems, wants to act as the product owner role and enjoys working shoulder-to-shoulder with an extremely talented and experienced Cloud Foundry BOSH engineering team. You will also join an amazing user community with passionate technologists like Dr Nic Williams. Watch Dr Nic's talk describing why he fell in love with Cloud Foundry BOSH in his presentation at PlatformCF in September of 2013.

We’re looking for someone passionate and conceptually aware of:
  • cloud operator user experience
  • cluster and data lifecycle management
  • vm/container orchestration
  • complex network management
  • disk volumes
  • software package management
  • basic monitoring

Dr Nic metaphor for BOSH at PlatformCF 2013
Cloud Foundry runtime is a PaaS for running apps and services. Underneath the PaaS, there is a whole other aspect of Cloud Foundry named BOSH (Bosh Outer SHell), which was inspired by the systems in use at Google, Amazon, Facebook and Twitter to deploy and manage their software across many data centers around the world. There is not anything else available in open source that has the same scope and capabilities. Apache Mesos is in the same space, but has a different architecture that doesn't focus on IaaS orchestration, utilizing base operating system images and fine-grained control over network and disk. Cloud Foundry BOSH is the secret sauce that enables running the same Cloud Foundry runtime software on VMware, Amazon and OpenStack infrastructure-as-a-service changing only a minimal amount of infrastructure specific configuration. Not only does BOSH deploy these systems across hundreds or thousands of instances, but it is also able to keep them up-to-date without downtime as new software and fixes are released and rolled through the machines incrementally including kernel patches and middleware.

Cluster lifecycle management and operator user experience will be main focus areas for BOSH in 2014. Many stateful scale-out clustered data services that Cloud Foundry users want to deploy and manage with BOSH have nuances around startup sequence, whether cluster nodes can run in a mixed version cluster, and related considerations. This is a hard problem that when solved well, will be unique in the open source community.

Recently, we made it possible to use BOSH on a developer class machine with bosh-lite. The bosh-lite project uses vagrant and Linux Containers. Instead of traditional IaaS with multiple VMs for each role, bosh-lite uses linux containers inside of a single linux host. Therefore it is much faster to develop and test a BOSH release with fewer resources.

One of the best things the work is the collaboration process. Pivotal truly values the product owner / product manager (PM) role. This role makes the key product decisions with input from all stakeholders, but ultimately the product owner is responsible for defining the product. The PM is embedded shoulder-to-shoulder with the engineering team and is responsible for representing end-users and should meet with customers to build user empathy. The PM prioritizes the daily work items for the engineering team with the agile software tool Pivotal Tracker. if the PM prioritizes a feature in the engineering backlog, we can have it in production in days. The feeling of true influence and collaboration over the product destiny cannot be contrasted enough with the experience I had with a traditional waterfall process, such as my time in Product Management at Oracle.

Another incredible benefit is that you will be working with a truly world class product management team including James Watters, Matt Reider, Shannon Coen, Justin Richard, Scott Truitt, Mark Kropf, Ryan Morgan and Tammer Saleh. We work at 875 Howard St in downtown San Francisco, walking distance from many commute options and have incredible amenities.

If you read this far, then you should get in touch with and reference the BOSH PM position or reach out to me on twitter.

Additional reading:

Google Omega:

Mesos - open source clustering platform in use at Twitter and others:

Yarn - distributed workload management using Hadoop 2.0+

Systems and configuration management automation:

Distributed linux container management:


«Oldest   ‹Older   201 – 216 of 216
Kashif said...

I have read your blog and I gathered some needful information from your blog. Keep update your blog. Waiting for your next update.

360digitmgdelhi said...

Thankyou for this wondrous post, I am cheerful I watched this site on yahoo.

dataanalyticscourse said...

thanks for the information seeks such more blogs with complete knowledge.
data analytics course

laxmi said...

SCCM online training
SCOM online training
MSBI online training
salesforce online training
Mulesoft online training
Webmethods online training

Anonymous said...


Huongkv said...

Liên hệ Aivivu, đặt vé máy bay tham khảo

Ve may bay di My

bán vé máy bay từ mỹ về việt nam

mua vé máy bay chu lai đi sài gòn

vé máy bay đi hà nội tháng 2

vé máy bay cần thơ đà nẵng vietnam airline

Anonymous said...

Very informative. Thanks for sharing.

Best Bike Taxi Service in Hyderabad
Best Software Service in Hyderabad
Electric Vehicle Charing Stations

thomasjack said...

Amazing product thanks for sharing with us It is very informative. If you need any type of boxes you can visit the link.
Cosmetic packaging boxes
Corrugated boxes wholesale

Machine Learning Course in Bangalore said...

Truly incredible blog found to be very impressive due to which the learners who ever go through it will try to explore themselves with the content to develop the skills to an extreme level. Eventually, thanking the blogger to come up with such an phenomenal content. Hope you arrive with the similar content in future as well.

Machine Learning Course in Bangalore

Serina johson said...

I appreciate your post thanks for sharing the information.
custom Perfume Subscription Boxes wholesale
buy Photography Packaging Boxes

Technogeekscs said...

I am really happy with your blog because your article is very unique and powerful for new.

RPA Training in Pune
Best RPA Training in Pune

Sneha Cubestech said...

Thanks for sharing this information with us
Visit -Elewayte - Best Online Certification courses to get trained in one of the best online training institutions with internships and placement assistance

Unknown said...

Thank you for sharing wonderful content
data science courses in chennai

Professional Course said...

Register for the Data Science certification in Bangalore and gain recognition and credibility in your organization. Learn the techniques to examine large data sets and discover patterns that are valuable to predict market trends. Learn Data Exploration and Visualizations, Neural Networks and Deep Learning, Model Evaluation and Analysis. This course will ensure that you are challenged to go from a beginner with no Data Science experience to someone who can juggle data with ease.

Data Science Training and Placement in Bangalore

Data Science said...

I am another customer of this site so here I saw various articles and posts
posted by this site,I curious more energy for some of them trust you will give more information further.

Aravind said...

Outstanding post, packed with valuable information. Please continue to share content like this; it's truly appreciated!
ui developer course in hyderabad,

«Oldest ‹Older   201 – 216 of 216   Newer› Newest»