Peepaal

Continuous Community Learning

Hybrid Storage Cloud

 Problem Statement and Scope

  • Suppose if a client is subscribed to Cloud A and is using some of its resources, and wants to scale up.  As the demands are dynamic there is a possibility of the resources getting exhausted. These resources are available with another Cloud (say Cloud B) which can provide the services but Cloud-A can’t ask the client to go for Cloud-B.
  • So building up a interface where cloud A is interacting with Cloud B and providing the resources available with Cloud B.Where all this happens in background and the client has no clue .
  • This way it solves the problem of exhaustion of resources on the cloud.
  • This interface shall let the clouds share only the resources and not any other platform or software related services. 

Novelty of Idea

  • Basically this idea focuses towards extending the capability of already existing clouds by making them interact with each other by sharing their resources.
  • Enhancing the capabilities of the cloud.

Relevance and Applications

  • Scalability /Flexibility -
  • Cloud hosting companies can start with fairly small amount of deployed resources and grow into larger clouds by sharing resources.
  • Also, the flexibility of cloud computing allows companies to use extra resources at peak times, enabling them to satisfy consumer demands

 

 

2)  Solution  

 

Technology Layer/Solution

  • To implement the above idea we use Ubuntu as a platform and Java as a language.
  • It will be implemented on CLC (Cloud Controller) and CC (cluster controller) layer of the cloud architecture.

 

Proof of Concept
  • The Cluster Controller gathers information, schedules VM deployment, and manages the virtual network.
  • the cloud controller acts as an interface to the outside world. It makes higher-level scheduling decisions, and forwards commands to the cluster controllers.

 

 

3)  R&D

 

R&D Elements in the solution

  • As we study further on this project we shall come to know more about cloud, its architecture, its internal functioning and shall try to implement them by creating two private clouds and then implementing interaction among them. 
  • Improves on existing solution/Provides a new solution
  • The existing solution to this problem is that cloud owners have to increase their resources .
  • As against this by successfully implementing the above idea we can solve the problem of resource exhaustion which is a potential problem area.
by -

Meenal,Remya ,Smruti,Neeraj,Bhushan(FC folks)

Views: 42

Tags: Cloud Computing, Eucalyptus, Open Source

Comment

You need to be a member of Peepaal to add comments!

Join Peepaal

Comment by Smruti Pramod Palve on April 6, 2011 at 6:46am
thanks sir for it
Comment by Shyamal Pandya on April 5, 2011 at 12:05pm

Little off-track from the technical discussion going on here  but an interesting read. On the lines of what you guys are doing : 

 

http://www.eweek.com/c/a/Data-Storage/Cloud-Storage-Standard-Moving...

 

Regards,

Shyamal

 

Comment by Anoop Kunchukuttan on March 28, 2011 at 8:00pm

Too many things you seem to be doing, I am getting confused :)

As we talked, here are the 3 tasks you should focus on:

- Be able to connect to Amazon S3 using jets3t API

- Make sure your local cloud installation is working fine

- Download the Eucalyptus source code, and read the paper related to Eucalyptus architecture. For starters, identify the part of the source code related to Walrus.

Comment by Kaushik on March 28, 2011 at 11:07am
That code that you are using is fine. Just see if you can get it to work. Also you do not need to create buckets etc, only focus on the core aspect, connecting and putting a simple text file in an existing bucket.
Comment by Smruti Pramod Palve on March 28, 2011 at 9:17am
i tried s3cmd --configure it has been done.but when i tried to get list of all bucket by it gave error abt config i.e s3cfg.walrus(config file for walrus)
Comment by Smruti Pramod Palve on March 28, 2011 at 8:45am

To run an image in the cloud, you must produce a bundled image and upload it in the cloud. Walrus acts as a storage manager: It receives the image from you and stores it as buckets and objects. When you want to access the image from the cloud, Walrus is entrusted with the task of verifying and decrypting images that have been uploaded by users.

 

When you want to store an image, a separate bucket is created for each user with a unique bucket name. Using S3cmd, create a bucket and bucket name:

$ s3cmd mb s3://my-new-bucket-name
Comment by Smruti Pramod Palve on March 28, 2011 at 8:41am
now i am trying to give direct access key and secret key from gui or command line to jets3t
Comment by Smruti Pramod Palve on March 28, 2011 at 8:39am

 yes kaushik sir i have seen it.

that code which we were having package problem was the same just it was collection of all code in one program.on coming saturday i will just show it to anoop sir get approval to use it to interact directly with amazon

Comment by Smruti Pramod Palve on March 28, 2011 at 8:31am

Setup s3cmd

Pre-requisites: python and python-openssl.

 is this a point we are not getting bucket part from s3cmd commands

Comment by Kaushik on March 28, 2011 at 8:30am

BTW did you manage to get the jets3t to work ? The code samples at the url below seem to be very easy and i would think they should work. All you need to implement from the sample is connecting to S3 and upload data objects.

 

http://jets3t.s3.amazonaws.com/toolkit/code-samples.html#connecting

 

© 2012   Created by Kaushik.

Badges  |  Report an Issue  |  Terms of Service