The Python implementation of MimicDB works with the Boto library and several different backends including Redis.
By default, MimicDB requires Redis (although other backends can be used instead).
pip install boto pip install redis pip install mimicdb
If you're using Boto already, replace
boto imports with
from boto.s3.connection import S3Connection from boto.s3.key import Key
from mimicdb.s3.connection import S3Connection from mimicdb.s3.key import Key
Additionally, import the MimicDB object itself, and initiate the backend:
from mimicdb import MimicDB MimicDB()
After establishing a connection for the first time, sync the connection to save the metadata locally:
conn = S3Connection(KEY, SECRET) conn.sync()
Or sync only a couple buckets from the connection:
After that, upload, download and list as you usually would. API calls that can be responded to locally will return instantly without hitting S3 servers. API calls that are made to S3 using MimicDB will be mimicked locally to ensure consistency with the remote servers.
force=True to most functions to force a call to the S3 API. This also updates the local database.
Besides the default Redis backend, MimicDB has SQLite and in-memory backends available.
from mimicdb.backends.sqlite import SQLite MimicDB(SQLite())
from mimicdb.backends.memory import Memory MimicDB(Memory())
Run tests after installing nose and coverage.
$ nosetests --with-coverage --cover-package=mimicdb
Integration testing is provided by Travis-CI at travis-ci.org/nathancahill/mimicdb
Test coverage reporting is provided by Coveralls at coveralls.io/r/nathancahill/mimicdb
benchmarks.py in the root of the repo:
$ python benchmarks.py Boto Time: 0.338411092758 MimicDB Time: 0.00015789039612 Factor: 2143x faster
MimicDB is BSD licensed.