Romance, Historical, Contemporary, Paranormal, Young Adult, Book reviews, industry news, and commentary from a reader's point of view

Create Your Own Cloud of Ebooks with Calibre + Calibre OPDS...

This post has been updated as of October 16, 2011.  

*****

Apple appears to have pushed Google out of the ebookstore.  Kobo released an updated app with no buy link.  Google is randomly deleting Google Plus accounts.  Yet another ebook format has been announced.  I’m getting pretty fed up with the powers that be who run the ebook world.  The biggest weapon that readers have in their arsenal is the ability to decouple.  This means taking your books out of the cloud (the servers of Amazon, Apple, Google, BN, or Kobo) and putting them into your own cloud.  You can set up your cloud for free using open source programs and a free account at dropbox.  (alternatively you can create your own syncing system by using alternative systems discussed on Lifehacker or this great device which I am going to check out called PogoPlug).

This cloud set up allows you to have access, either by webbrowser (the Kindle 3′s browser works too) or by iPhone/iTouch, to your entire ebook catalog from anywhere you can get internet connection, whether by wifi or cellular access.   The catalog generated is incredibly feature rich.   You can browse your catalog by series, tags, author, title, and most recent additions. You can look up a book on Goodreads or check out the wikipage for an author. Take a look at these iPhone screenshots (click for bigger images):

Book viewAuthor ListBookView

More dataRecentTags

In order to create your own cloud of books, you’ll need three pieces of free software:  Calibre, Calibre OPDS & some kind of syncing software.  For this explanation, I use dropbox.

Step 1: You need a cloud.

Dropbox logo

The cloud is essentially a computer harddrive space that you can access anywhere in the world so long as you can log onto the internet. Dropbox provides a 2 GB cloud for free and works on Windows, MAC, Linux, and the iPhone. Dropbox is particularly suited for this cloudy goodness because of its automatic synching abilities. Every time your files change on your harddrive, Dropbox notes that and uploads the changed file.

So step 1 is signing up for a dropbox account. Sign up and install the software program. The software program will require you to designate a Dropbox folder on your computer. Within that Dropbox folder is where you will put your ebooks.

Step 2: Set up your ebook cloud location.

Ebook Cloud Location

In this step you are going to create a folder within the public folder of the dropbox folder. This public folder will allow you to access your ebook cloud anywhere. While the name of the folder is “public”, it is only public if you share the link (which is why mine is fake in this example) so don’t share the link. Also, you may want to use a random character generator to create a folder name to create a link that is even more secure.   Just don’t make the name too long. 8-10 letters is good.

Step 3. Download Calibre

Calibre is the best ebook software out there. The Best. Even if you don’t use Calibre to create a cloud of goodness, it is still a great management tool. I highly, highly recommend it for every ebook reader out there.

When you install Calibre, just use the standard install rather than advanced.

Step 4. Set Your Calibre Library to be in the Cloud.

Open Calibre. Click on the bookshelf button in the toolbar and then change the location of the ebooks to the “My Dropbox\Public\SECRET FOLDER” that you created in Step 2.  Note that under the newer versions of Calibre, you can maintain multiple libraries. I maintain three: one for books I’ve purchased, one for ARCs and one that contains no ebook files but generates the Dear Author coming soon catalogs.

library icon

If you already have Calibre, you will simply change your existing files to this new location.   If your database is big, go take a big break.   Calibre will copy over every file to this new location and that can take some time.

move library to new location calibre

Step 5. Download Calibre OPDS

This is an open source program written by David Pierron. It runs without adding new software to your computer or changing drivers or anything crazy like that. This is the site for Calibre OPDS.

It is based on the Open Publication Distribution System cataloguing system.

Step 6:    Download the Calibre OPDS installer

David is working to update this program all the time. The latest development are installers for both Windows and Mac.  Simply download the program and follow the ordinary installation steps.   A Calibre OPDS icon will be available.  If you are on a MAC, you may simply get a bunch of icons:

Calibre OPDS folder

OpdsOutput-2.4-SNAPSHOT.jar is the icon to click on that will open the Calibre program for you.

Double click on it and the program will open, showing a window like this (click for a larger image).   The Database Folder is where the “metadata.db” file resides which should be the folder you created in Step 2. If you have separate calibre libraries, you’ll have to change the location of the library for each catalog you want to create.     Catalog folder is where you want the catalogs to be generated.   Name it whatever you want.  The default is “_catalog” and this will make it show up at the top of the folder.
Calibre OPDS screen

There are lots of different options you can choose which will affect the way in which your catalog will look but the most important customization is “Compatibility Level”.

Compatibility level on calibre opds

  • OPDS is for general catalogs (i.e., if you are only going to access your catalogs via a web browser).
  • TROOK is for rooted nook classic devices.
  • STANZA is for Stanza App on iThing  Stanza has been killed for iOS 5.  Use OPDS if you have an iThing with IOS 5 or above.
  • Aldiko is for Android App Aldiko
If you don’t use the right compatibility level, your catalog will not work with your application.  THIS IS IMPORTANT.

STEP 7. Create the catalogs:

Once you have customized your setup, click “Generate catalogs”.  A new window should popup to show the progress:

Calibre OPDS progress screen

If you have mobi or PDF files in your catalogs, remember to go to Advanced customization features and type in your additional formats:

Calibre OPDS included formats option

Make sure that “include only one ebook file” is not checked.

Another way to double check this is to go to your SECRETFOLDER and look for a folder called _catalog.  Look for the file titled “index.html” and double click. Your browser should launch and your catalog should look something like this:

 

index.html for Calibre OPDS catalog

 

Done yet? Yes, if all you want is web access.  

This next part is adding the catalog to your iPhone.  Check out Stanza alternatives.

Step 1. Open up your favorite app on your iPhone.

Step 2.   Add a new catalog.

Enter your catalog name. It can be whatever you like.   The URL is the path to your dropbox public folder.   You can get this path by doing the following:

Go to your SECRET FOLDER and click on the “_catalog” folder created above in Step 8.   Look for the file named “index.xml“.   There will be a index.html but you want index.xml. Highlight that file.   Right click, scroll to Dropbox, and in the fly out is “copy public link“.

Once you have the public link, paste it somewhere (like in a word document or a notepad file, etc). It should look something like this:

http://dl.dropbox.com/u/212378/SECRETFOLDER/_catalog/catalog.xml

This entire path must be typed into the URL of the iphone.

DONE.

In the future, anytime you make a change to your Calibre database, you will want to update your catalogs.

As an aside, I no longer use Stanza but on the iOS platform, you can download an epub or mobi file from Safari and be presented with the “Open In” option allowing you to read the epub or mobi file in most apps (all apps except the BN app).

Another great thing is if you have Bluefire authorized with your Adobe Digital Editions account, you don’t need to strip the DRM from the epubs although if you want to, there are plugins for Calibre that help you do that. (Note that stripping DRM may be illegal in your jurisdiction or country).

Have questions? Leave them in the comments.

Jane Litte is the founder of Dear Author, a lawyer, and a lover of pencil skirts. She spends her downtime reading romances and writing about them. Her TBR pile is much larger than the one shown in the picture and not as pretty. You can reach Jane by email at jane @ dearauthor dot com

219 Comments

  1. Felix
    Jun 28, 2012 @ 20:12:49

    Great tutorial! You may have already known that the latest version of Stanza runs on iOS 5, it now crashes on iOS 4 though.

    I used to use Calibre + Calibre OPDS, but the setup is bit complicated and regenerating the catalog every time manually is annoying. So I end up with a simple Web service I programmed, catalog.im. It helps me to organize all my ebook collections and it gives a up-to-date OPDS feed. All I need to do is to upload my ebooks, and these ebooks will appear in the library and the OPDS feed.

    I would like to invite you Jane to try it out :D

    OK, I admit, it’s a promotion :ashamed:

    ReplyReply

  2. itswerkin
    Oct 09, 2012 @ 20:39:17

    @Felix, would love an invite to catalog.im, have had many problems w/ Calibre, all stemming from lack of multiuser support and lack of network SQL backend and am interested in your approach. itwerks4me at gmail dot com

    ReplyReply

  3. Weekly Research Index | February 19, 2010 « The Xplanation
    Oct 19, 2012 @ 16:24:14

    [...] Create Your Own Cloud of Ebooks with Calibre + Calibre OPDS + Dropbox | Dear Author: Romance Novel R… — This is a great DIY article on how to publish your own e-book cloud. [...]

  4. An iOS App Update
    Dec 16, 2012 @ 13:37:10

    [...] the inability to sort by date can be really frustrating.  I’ve tried to work around that by creating OPDS catalogs but even that can be a hassle.  Being able to sort by date modified was so wonderful I almost [...]

  5. A secure alternative to Dropbox: Tondio, SpiderOak, Cubby, and GoodSync
    Dec 23, 2012 @ 08:20:11

    [...] access to files while on the road.  I have used this service and program for a few years and have written out instructions on how to create one’s own cloud of ebooks using Dropbox.  However, Dropbox, like Gmail is a [...]

  6. mantsan
    Mar 11, 2013 @ 05:12:44

    Buenos días,
    no consigo instalar calibre2opds en windows 7

    ReplyReply

  7. Pam
    May 16, 2013 @ 15:57:05

    I feel really dumb. I followed all the steps up to the point of “Done yet? Yes, if all you want is web access.” I have everything on Dropbox, my entire Library and my calibreopds folder with the catalog generated. I have an index.html file. What do I do with it? If I want to share this Cloud with my friend, what do I do? If I want to access my Library from the Cloud from another computer, what do I do? I’m stumped and I feel almost like the tutorial ended before it was finished because that’s an important step that’s missing.

    Thank you.

    ReplyReply

  8. Jane
    May 16, 2013 @ 16:57:22

    @Pam: I’m not sure what you want to do with it. Dropbox is a syncing program so it creates a duplicate of what you have in your Dropbox folder on a remote computer. You can access these remote files from a mobile device or from another computer.

    ReplyReply

  9. Pam
    May 16, 2013 @ 17:04:28

    @Jane: I just wanted to be able to create my online catalog on the Cloud/Dropbox and then share the index.html link with my friend so she could bookmark it and download my books too. I thought that was how it worked. I may have misunderstood the whole point of OPDS. If that’s not what it’s for, I don’t see what it’s for because it’s true I can just go directly into my Dropbox and get the books that way. Although I like the interface and layout of the index.html. It’s more navigable than going through Dropbox.

    How could I use my index.html file online from a web browser to access my books, if I were on another computer and didn’t have direct access to my Dropbox?

    ReplyReply

  10. Jane
    May 16, 2013 @ 17:08:57

    @Pam: Right click on the index.html file and you should have the option to create a shareable link. That’s the link you’ll want to bookmark and the one to send to your friend.

    ReplyReply

  11. Pam
    May 16, 2013 @ 17:58:43

    Thanks for trying to help. That didn’t work. I share the index.html, which opens fine, but Dropbox won’t allow access to the other files that index.html is linking to, even if I’ve shared the entire Library folder with her. I myself can’t use index.html to access the files and it’s my Dropbox. I get an error message that says: “Error (403) It seems you don’t belong here! You should probably sign in.” That’s even if I’m already signed in.

    Ah well. I guess I’ll just run the Calibre content server that comes with the Calibre software and see if she can access my files that way.

    Thanks again.

    ReplyReply

  12. Marcia
    May 24, 2013 @ 07:57:24

    Hi there, i read your blog from time to time and i own a similar one and i was just curious if you get a lot of spam remarks? If so how do you stop it, any plugin or anything you can suggest? I get so much lately it’s driving me crazy so any support is very much appreciated.

    ReplyReply

  13. Angelica
    Jun 24, 2013 @ 08:30:35

    Jane I got confused, so does that mean that I need to download a new one each phone I use?

    ReplyReply

  14. Jane
    Jun 24, 2013 @ 08:44:58

    @Angelica: Download a new copy of a book? Yes, you’d have to download a new copy to each new device you own.

    ReplyReply

  15. Leonieke Net | Create Your Own Cloud of Ebooks with Calibre + Calibre OPDS + Dropbox | Link
    Aug 23, 2013 @ 16:23:41

    […] Create Your Own Cloud of Ebooks with Calibre + Calibre OPDS + Dropbox | http://dearauthor.com/ebooks/create-your-own-cloud-of-ebooks-with-calibre-calibre-opds-dropbox/ […]

  16. Marvin for iPhone
    Sep 22, 2013 @ 04:02:07

    […] Create your own:  I’ve blogged about using Calibre and Calibre OPDS to create such a catalog. […]

  17. caleg medan unggulan
    Dec 22, 2013 @ 13:59:54

    Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point.
    You obviously know what youre talking about,
    why throw away your intelligence on just posting videos to your site when you could be giving us something enlightening to read?

    ReplyReply

  18. Teamwork quotes
    Mar 03, 2014 @ 14:50:54

    I really love your website.. Very nice colors & theme. Did you develop this
    website yourself? Please reply back as I’m hoping to create my own personal blog and would love
    to find out where you got this from or just what the theme is named.

    Thanks!

    ReplyReply

  19. watch titanic full movie youtube
    Mar 06, 2014 @ 23:47:49

    When I initially commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get several e-mails with the same comment.

    Is there any way you can remove people from that service?

    Thanks!

    ReplyReply

Leave a Reply

Notify me of followup comments via e-mail. You can also subscribe without commenting.

%d bloggers like this: