Skip to content
This repository has been archived by the owner on May 22, 2024. It is now read-only.

Core4ce/bloom-python-driver

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

50 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

bloom-python-driver

Pybloom provides a Python client library to interface with bloomd servers. The library supports multiple bloomd servers, and automatically handles filter discovery and sharding.

Features

  • Provides a simple API for using bloomd
  • Allows for using multiple bloomd servers
    • Auto-discovers filter locations
    • Balance the creation of new filters
    • Explicitly name the location to make filters
  • Command pipelining to reduce latency

Install

Download and install from source:

python setup.py install

Example

Using pybloom is very simple, and is similar to using native sets:

from pybloom import BloomdClient

# Create a client to a local bloomd server, default port
client = BloomdClient(["localhost"])

# Get or create the foobar filter
foobar = client.create_filter("foobar")

# Set a property and check it exists
foobar.add("Test Key!")
assert "Test Key!" in foobar

To support multiple servers, just add multiple servers:

from pybloom import BloomdClient

# Create a client to a multiple bloomd servers, default ports
client = BloomdClient(["bloomd1", "bloomd2"])

# Create 4 filters, should be on different machines
for x in xrange(4):
    client.create_filter("test%d" % x)

# Show which servers the filters are on by
# specifying the inc_server flag
print client.list_filters(inc_server=True)

# Use the filters
client["test0"].add("Hi there!")
client["test1"].add("ZING!")
client["test2"].add("Chuck Testa!")
client["test3"].add("Not cool, bro.")

Using pipelining is straightforward as well:

from pybloom import BloomdClient

# Create a client to a local bloomd server, default port
client = BloomdClient(["localhost"])

# Get or create the foobar filter
pipe = client.create_filter("pipe").pipeline()

# Chain multiple add commands
results = pipe.add("foo").add("bar").add("baz").execute()
assert results[0]
assert results[1]
assert results[2]

About

A python client library for bloomd servers

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 100.0%