Skip to content

StoneSteel27/FlowQ

Repository files navigation

FlowQ

Your Friendly Neighbourhood Distributed Computing System

FlowQ was created for the goal of making distributed computing free, simple and easier.

Features of FlowQ:

  • Effortless Setup: Ditch the complicated configurations! FlowQ runs right out of the box, no ssh headaches or pre-installation required.
  • Simple and Secure Connection: Leverages the Hack.Chat platform to establish secure, base-64 encrypted and anonymous connections with your computing cluster.
  • Temporary Storage: Need a place to store input and output files? FlowQ utilizes FileBin for convenient temporary storage.
  • Parallel Powerhouse: FlowQ unleashes the true potential of your network by executing tasks in parallel across your machines(with multi-threading), significantly boosting your processing speed.

I don't have any other computing devices, and I don't want to spend money....

  • Supercharge your cluster in seconds! FlowQ lets you seamlessly add new machines with Python. Just 2 lines of command, and you've got a processing powerhouse. FlowQ makes scaling effortless.
pip install FlowQ
python -m FlowQ.cluster -c <your-channel-name>
  • You can run these commands in your Google Colab Instances or any other computer, for scaling your cluster with ease.

Client Usage

  • You can set up your client, with simple FlowQlient Class!
from FlowQ.client import FlowQlient
flow = FlowQlient(channel="<your-channel-name>")
flow.connect(name="<your-user-name>")

@flow.task
def alpha(x):
    import math ## Import all the needed modules inside the function
    result = math.sin(x) ## Do The Required Processing
    return result ## return the resultant data

output = flow.get([alpha(i) for i in range(6)])

⚡Note⚡: Please initialize the cluster before running the Client code(This will be fixed in future updates)

⚡Note⚡: While executing the client in a jupyter notebook, don't forget to enable nest_asyncio first by:

!pip install nest_asyncio
import nest_asyncio
nest_asyncio.apply()

About

Your Friendly Neighbourhood Distributed Computing System

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages