Subscription

Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Learning Hub

Conferences

Free Learning

You're reading from Ceph Cookbook Practical recipes to design, implement, operate, and manage Ceph storage systems

Product type Paperback

Published in Nov 2017

Publisher Packt

ISBN-13 9781788391061

Length 466 pages

Edition 2nd Edition

Languages

C++

Tools

Ceph

Concepts

Cloud Computing

Authors (3):

Vikhyat Umrao

Michael Hackett

Karan Singh

View More author details

Table of Contents (15) Chapters

Preface

1. Ceph – Introduction and Beyond

2. Working with Ceph Block Device FREE CHAPTER

3. Working with Ceph and OpenStack

4. Working with Ceph Object Storage

5. Working with Ceph Object Storage Multi-Site v2

6. Working with the Ceph Filesystem

7. Monitoring Ceph Clusters

8. Operating and Managing a Ceph Cluster

9. Ceph under the Hood

10. Production Planning and Performance Tuning for Ceph

11. The Virtual Storage Manager for Ceph

12. More on Ceph

13. An Introduction to Troubleshooting Ceph

14. Upgrading Your Ceph Cluster from Hammer to Jewel

Integrating RADOS Gateway with Hadoop S3A plugin

For data analytics applications that require Hadoop Distributed File System (HDFS) access, the Ceph object gateway can be accessed using the Apache S3A connector for Hadoop. The S3A connector is an open source tool that presents S3 compatible object storage as an HDFS file system with HDFS file system read and write semantics to the applications while data is stored in the Ceph object gateway.

Ceph object gateway Jewel version 10.2.9 is fully compatible with the S3A connector that ships with Hadoop 2.7.3.

How to do it...

You can use client-node1 to configure Hadoop S3A client.

Install Java packages in the client-node1:

        # yum install java* -y

Download the...

The rest of the chapter is locked

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at €18.99/month. Cancel anytime

Authors (3)

Umrao

Vikhyat Umrao has 9 years of experience with distributed storage products as a sustenance engineer and in the last couple of years, he has been working on software-defined storage technology, with specific expertise in Ceph Unified Storage. He has been working on Ceph for over 3 years now and in his current position at Red Hat, he focuses on the support and development of Ceph to solve Red Hat Ceph storage customer issues and upstream reported issues. He is based in the Greater Boston area, where he is a principal software maintenance engineer for Red Hat Ceph Storage. Vikhyat lives with his wife, Pratima, and he likes to explore new places.

See other products by Umrao

Hackett

Michael Hackett is a storage and SAN expert in customer support. He has been working on Ceph and storage-related products for over 12 years. Apart from this, he holds several storage and SAN-based certifications and prides himself on his ability to troubleshoot and adapt to new complex issues. Michael is currently working at Red Hat, based in Massachusetts, where he is a principal software maintenance engineer for Red Hat Ceph and the technical product lead for the global Ceph team. Michael lives in Massachusetts with his wife, Nicole, his two sons, and their dog. He is an avid sports fan and enjoys time with his family.

See other products by Hackett

Karan Singh

Karan is an IT expert and passionate tech enthusiast living with his beautiful wife Monika in Finland. He holds Honours degree in Bachelor of Computer Science and a Master degree in System Engineering from BITS, Pilani. Apart from this, he is a certified professional for technologies like OpenStack, NetApp and Oracle Solaris. Karan is currently working as a System Specialist of Storage and Cloud Platform for CSC - IT Center for Science Ltd. focusing all his energies on providing IaaS cloud solutions based on OpenStack and Ceph and building economic multi-petabyte storage system using Ceph. Karan possesses a rich skill set and working experience of a variety of cloud technologies. He devotes a part of his time to R&D and learning technologies. He is also the author of the very first book on Ceph titled Learning Ceph, published in 2014. Karan possesses extensive system administration skills and has excellent working experience on a variety of Unix environments, backup, enterprise storage systems, and cloud platforms. When not working on Ceph and OpenStack, Karan can be found working with Configuration management, containers and devops related tools. He loves writing about technologies and is an avid blogger. You can reach him on Twitter.

See other products by Karan Singh