2023-02-23T17:05:19,985 Created temporary directory: /tmp/pip-ephem-wheel-cache-bqbj2zog 2023-02-23T17:05:19,987 Created temporary directory: /tmp/pip-build-tracker-kt_7i4go 2023-02-23T17:05:19,988 Initialized build tracking at /tmp/pip-build-tracker-kt_7i4go 2023-02-23T17:05:19,988 Created build tracker: /tmp/pip-build-tracker-kt_7i4go 2023-02-23T17:05:19,988 Entered build tracker: /tmp/pip-build-tracker-kt_7i4go 2023-02-23T17:05:19,989 Created temporary directory: /tmp/pip-wheel-qaksfr0t 2023-02-23T17:05:19,993 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-02-23T17:05:19,996 Created temporary directory: /tmp/pip-ephem-wheel-cache-s_v156kc 2023-02-23T17:05:20,025 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-02-23T17:05:20,029 2 location(s) to search for versions of flask-gcp-pubsub: 2023-02-23T17:05:20,029 * https://pypi.org/simple/flask-gcp-pubsub/ 2023-02-23T17:05:20,029 * https://www.piwheels.org/simple/flask-gcp-pubsub/ 2023-02-23T17:05:20,029 Fetching project page and analyzing links: https://pypi.org/simple/flask-gcp-pubsub/ 2023-02-23T17:05:20,030 Getting page https://pypi.org/simple/flask-gcp-pubsub/ 2023-02-23T17:05:20,031 Found index url https://pypi.org/simple 2023-02-23T17:05:20,083 Fetched page https://pypi.org/simple/flask-gcp-pubsub/ as application/vnd.pypi.simple.v1+json 2023-02-23T17:05:20,086 Found link https://files.pythonhosted.org/packages/86/31/f5c0b0a70ee4d7c459bff74edf868ebe4c3311dd6d1dc535cb1a6fd24839/flask-gcp-pubsub-0.0.0.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.0.0 2023-02-23T17:05:20,087 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/df/fe/187a54cb034585f0abe1d20c5cb4aaaf42e29cb930da9f7c0be19dcef9bd/flask_gcp_pubsub-0.0.0-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,087 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/dd/5d/2d880d93e3d6974f8d979bae7edd9eecf4b1b8c3b8151af857beef431435/flask_gcp_pubsub-0.1.0-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,088 Found link https://files.pythonhosted.org/packages/af/63/e087cee3bb381340c63abae72693e15b6886816651c2175c7771c3e395de/flask-gcp-pubsub-0.1.1.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.1.1 2023-02-23T17:05:20,088 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/31/82/5003e5fe58dfdd54e0e165d3e4a3e3c365923130b737dc13a15b7b84c009/flask_gcp_pubsub-0.1.1-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,088 Found link https://files.pythonhosted.org/packages/8f/7d/e18e9635401330bc156bfe087716e0f3244d5c3c50a9515415b262b9574f/flask-gcp-pubsub-0.1.2.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.1.2 2023-02-23T17:05:20,089 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/78/cd/601af34e8214c3df745b3e53cbfd7b97d6b1671a0cd04656f1dff85d1430/flask_gcp_pubsub-0.1.2-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,089 Found link https://files.pythonhosted.org/packages/ca/e1/f5ea6e88d9c73bef5c1930ff049f0cbc4eecc2a064e603978239b0e5a112/flask-gcp-pubsub-0.2.0.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.2.0 2023-02-23T17:05:20,090 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/c3/eb/d2d31a4a47508e34ffc44b5aba4931f6134f2332de3c32ac121e004f4d88/flask_gcp_pubsub-0.2.0-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,090 Found link https://files.pythonhosted.org/packages/42/50/b0f9451c844df9633bce784ae62e3ed22321311e6947976b0444d5d48264/flask-gcp-pubsub-0.2.1.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.2.1 2023-02-23T17:05:20,091 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/8f/43/d6a1e9e73f70458587f4d20142413c8a26062f34752ea0312bd5b9689d35/flask_gcp_pubsub-0.2.1-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,091 Found link https://files.pythonhosted.org/packages/e2/44/22d058e464c69d441c44c594708c80d4e73d058557620d3db7dfaf75db72/flask-gcp-pubsub-0.2.2.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.2.2 2023-02-23T17:05:20,091 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/07/4d/506fb918ff1fa263deb39b63d0d9e333c6d99805044ffbdc0a00ee229254/flask_gcp_pubsub-0.2.2-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,092 Fetching project page and analyzing links: https://www.piwheels.org/simple/flask-gcp-pubsub/ 2023-02-23T17:05:20,092 Getting page https://www.piwheels.org/simple/flask-gcp-pubsub/ 2023-02-23T17:05:20,093 Found index url https://www.piwheels.org/simple 2023-02-23T17:05:20,422 Fetched page https://www.piwheels.org/simple/flask-gcp-pubsub/ as text/html 2023-02-23T17:05:20,428 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.2.1-py3-none-any.whl#sha256=8aeaf5e808c46f4266f3e28b374c2d017144564e71e536f60221a7a3ea094703 (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,429 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.2.0-py3-none-any.whl#sha256=09f9b0d31963f2cac92d927cfc7fe935e346abef0a6a4662198442eeedb74ba8 (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,430 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.1.2-py3-none-any.whl#sha256=c7af52c9e03268207a069fb9977052054bbeff82d2bba29490d3a70c0d68ad3e (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,430 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.1.1-py3-none-any.whl#sha256=c1fa0b3cd09351a7d90d1d79b52a5c796e0d9649c0578297467820b6432f7b48 (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,431 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.0.0-py3-none-any.whl#sha256=00de094418db500b7a05819cc68496778fcd13b0f6c0108549b87f81b96fa4a8 (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-23T17:05:20,431 Skipping link: not a file: https://www.piwheels.org/simple/flask-gcp-pubsub/ 2023-02-23T17:05:20,432 Skipping link: not a file: https://pypi.org/simple/flask-gcp-pubsub/ 2023-02-23T17:05:20,478 Given no hashes to check 1 links for project 'flask-gcp-pubsub': discarding no candidates 2023-02-23T17:05:20,496 Collecting flask-gcp-pubsub==0.2.2 2023-02-23T17:05:20,498 Created temporary directory: /tmp/pip-unpack-s0sc9km2 2023-02-23T17:05:20,684 Downloading flask-gcp-pubsub-0.2.2.tar.gz (21 kB) 2023-02-23T17:05:20,727 Added flask-gcp-pubsub==0.2.2 from https://files.pythonhosted.org/packages/e2/44/22d058e464c69d441c44c594708c80d4e73d058557620d3db7dfaf75db72/flask-gcp-pubsub-0.2.2.tar.gz to build tracker '/tmp/pip-build-tracker-kt_7i4go' 2023-02-23T17:05:20,732 Created temporary directory: /tmp/pip-build-env-oplpv9ip 2023-02-23T17:05:20,742 Installing build dependencies: started 2023-02-23T17:05:20,743 Running command pip subprocess to install build dependencies 2023-02-23T17:05:21,951 Using pip 23.0.1 from /usr/local/lib/python3.9/dist-packages/pip (python 3.9) 2023-02-23T17:05:22,528 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-02-23T17:05:22,554 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-02-23T17:05:24,281 Collecting setuptools>=61.0.0 2023-02-23T17:05:24,389 Using cached https://www.piwheels.org/simple/setuptools/setuptools-67.4.0-py3-none-any.whl (1.1 MB) 2023-02-23T17:05:24,652 Collecting wheel 2023-02-23T17:05:24,724 Using cached https://www.piwheels.org/simple/wheel/wheel-0.38.4-py3-none-any.whl (36 kB) 2023-02-23T17:05:26,458 Installing collected packages: wheel, setuptools 2023-02-23T17:05:26,609 Creating /tmp/pip-build-env-oplpv9ip/overlay/bin 2023-02-23T17:05:26,612 changing mode of /tmp/pip-build-env-oplpv9ip/overlay/bin/wheel to 755 2023-02-23T17:05:28,836 Successfully installed setuptools-67.4.0 wheel-0.38.4 2023-02-23T17:05:29,344 Installing build dependencies: finished with status 'done' 2023-02-23T17:05:29,350 Getting requirements to build wheel: started 2023-02-23T17:05:29,351 Running command Getting requirements to build wheel 2023-02-23T17:05:29,903 /tmp/pip-build-env-oplpv9ip/overlay/lib/python3.9/site-packages/setuptools/config/_apply_pyprojecttoml.py:103: _WouldIgnoreField: 'readme' defined outside of `pyproject.toml` would be ignored. 2023-02-23T17:05:29,904 !! 2023-02-23T17:05:29,904 ########################################################################## 2023-02-23T17:05:29,904 # configuration would be ignored/result in error due to `pyproject.toml` # 2023-02-23T17:05:29,905 ########################################################################## 2023-02-23T17:05:29,905 The following seems to be defined outside of `pyproject.toml`: 2023-02-23T17:05:29,905 `readme = '# Flask GCP Pub/Sub\n\nLite distributed task queue using Google Cloud Platform (GCP) Pub/Sub\n\n[![PyPI version](https://img.shields.io/pypi/v/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![PyPI downloads](https://img.shields.io/pypi/dm/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![GNU GPLv3](https://img.shields.io/github/license/wildsys/flask-gcp-pubsub)](https://www.gnu.org/licenses/gpl-3.0.html)\n\n\n\n- [🤔 What does this package does?](#-what-does-this-package-does)\n- [🚀 Getting started](#-getting-started)\n - [Prerequisites](#prerequisites)\n - [Installation](#installation)\n - [Full example](#full-example)\n - [Bucket notification](#bucket-notification)\n - [Configuration](#configuration)\n- [🔮 Roadmap](#-roadmap)\n - [TO BE CONFIRMED](#to-be-confirmed)\n\n\n\n## 🤔 What does this package does?\n\nAs Celery, but in a lighter version, this package allows you to run operations asynchronously in your Flask project, but without the choice of the broker: it only uses GCP Pub/Sub.\n\nTechnically, this package can run without Flask, but, historically, it comes to have a quick-win for migrating to GCP Cloud Run using the Pub/Sub system, from an existing project using Flask + Celery.\n\nThis package aims to remove some painful tasks by:\n- Creating one dedicated topic for each function\n- Creating one dedicated reusable subscription for each function\n\nWe **do not recommand** this package for the following cases:\n- You need to reuse your development in a multi-cloud context\n- You have high volume of messages to process (not tested)\n\nThis package is given "as it", without garantees, under the GPLv3 License.\n\n## 🚀 Getting started\n\n### Prerequisites\n\n- A [Google Cloud account](https://console.cloud.google.com/)\n- A GCP project ([here to create a new one](https://console.cloud.google.com/projectcreate)), with [Pub/Sub API enabled](https://console.cloud.google.com/apis/library/pubsub.googleapis.com) (take care to select the good one)\n- A [Service Account](https://console.cloud.google.com/iam-admin/serviceaccounts) for which one you need a credential JSON file (`creds.json` in example below), with roles:\n - Pub/Sub Admin\n- A local environment with Python >= 3.9\n\n### Installation\n\n```python\npip install flask-gcp-pubsub\n```\n\n### Full example\n\n`demo.py`\n```python\n#!/usr/bin/env python\n# coding: utf-8\n\nfrom flask import Flask, make_response\nfrom flask_gcp_pubsub import PubSub\n\napp = Flask(__name__)\npubsub = PubSub(\n app,\n project_id=\'\',\n gcp_credentials_file=\'./creds.json\'\n)\n\n@pubsub.task\ndef my_task(msg1, msg2):\n """Awesome delayed execution"""\n print(\'test\', msg1, msg2)\n return \'ok\'\n\n@app.route(\'/test\')\ndef route_test():\n """Launch delayed execution"""\n my_task.delay(\'test1\', \'test2\')\n return make_response(\'ok\', 200)\n```\n\n**WARNING**: do not forget to replace `` with you GCP project ID (not number) and to downloed the JSON-formatted key from GCP Console.\n\n`wsgi.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import app\n\n# Start\nif __name__ == \'__main__\':\n app.run()\n```\n\n`wsgi_delayed.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import pubsub\n\n# Start\nif __name__ == \'__main__\':\n pubsub.run()\n```\n\nThis command will launch the Flask server:\n```shell\nflask run --port 9090\n```\n\nThis command will launch the asynchronous tasks manager:\n```shell\npython wsgi_delayed.py\n```\n\nYou can now navigate to http://localhost:9090/test\nAnd if everything goes OK, you just have to check the content of the output in console, which should look something like that:\n```\nStart consumers\nstatus=received message_id=6860318059876990 function=my_task\ntest test1 test2\nstatus=processed message_id=6860318059876990 function=my_task result=ok execution_time=6.818771362304688e-05\n```\n\n### Bucket notification\n\nYou can also create a task based on GCP Storage, by receiving a notification on any supported event from a bucket.\n\n```python\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_FINALIZE\'])\ndef my_bucket_notifications_create(*args, **kwargs):\n print(\'FINALIZE\', args, kwargs)\n\n\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_DELETE\'])\ndef my_bucket_notifications_delete(*args, **kwargs):\n print(\'DELETE\', args, kwargs)\n```\n\nFor the specific Storage product, Google create a specific Service Account for specific actions, that you cannot choose. [You can found it here.](https://console.cloud.google.com/storage/settings;tab=project_access)\n\nYou have to add the **Pub/Sub Admin** role for that particular Service Account in [IAM](https://console.cloud.google.com/iam-admin/iam).\n\nThe *kwargs* returns [all attributes of the Pub/Sub notification](https://cloud.google.com/storage/docs/pubsub-notifications#attributes).\n\nIf you change the function name, the auto-clean included at start-up cannot works. As you cannot excess 10 events per bucket, do not forget to clean previous subscription with commands:\n\n```shell\ngcloud storage buckets notifications list gs://\ngcloud storage buckets notifications delete gs://\n```\n\n### Configuration\n\nConfiguration can be done using keyword arguments in class instantiation and/or flask environment variable (set with `config.update`).\nIf both method used for one configuration key, the class instanciation is primary.\n\n| Flask env variable | Keyword argument | Usage | How-to get? |\n|-|-|-|-|\n| `PUBSUB_PROJECT_ID` | `project_id` | GCP project ID | See [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_JSON` | `gcp_credentials_json` | Service account credentials, as JSON string format | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_FILE` | `gcp_credentials_file` | Servicce account credentials, as JSON local file | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CONCURRENT_CONSUMERS` | `concurrent_consumers` | Number of simultaneous consumer (default: `4`) | |\n| `PUBSUB_CONCURRENT_MESSAGES` | `concurrent_messages` | Number of messages pull from topic per consumer per call (default: `2`) | |\n| `PUBSUB_TOPIC_PREFIX` | `topic_prefix` | Prefix for all topic used in the instance, useful for feature branches using same project. | |\n\n\n## 🔮 Roadmap\n\n- [ ] Priority in the treatment of messages per functions\n- [ ] Logging instead of print (+ option to format as JSON)\n- [ ] Contributing manual\n- [ ] Documentation about Flask configuration keys and their counterpart on PubSub direct call\n\n### TO BE CONFIRMED\n\n- [ ] Region selection (default: all regions) - can be edited in Storage Rules of Topic for the moment\n'` 2023-02-23T17:05:29,906 According to the spec (see the link below), however, setuptools CANNOT 2023-02-23T17:05:29,906 consider this value unless 'readme' is listed as `dynamic`. 2023-02-23T17:05:29,906 https://packaging.python.org/en/latest/specifications/declaring-project-metadata/ 2023-02-23T17:05:29,906 For the time being, `setuptools` will still consider the given value (as a 2023-02-23T17:05:29,907 **transitional** measure), but please note that future releases of setuptools will 2023-02-23T17:05:29,907 follow strictly the standard. 2023-02-23T17:05:29,907 To prevent this warning, you can list 'readme' under `dynamic` or alternatively 2023-02-23T17:05:29,907 remove the `[project]` table from your file and rely entirely on other means of 2023-02-23T17:05:29,907 configuration. 2023-02-23T17:05:29,908 !! 2023-02-23T17:05:29,908 warnings.warn(msg, _WouldIgnoreField) 2023-02-23T17:05:30,202 running egg_info 2023-02-23T17:05:30,207 writing src/flask_gcp_pubsub.egg-info/PKG-INFO 2023-02-23T17:05:30,210 writing dependency_links to src/flask_gcp_pubsub.egg-info/dependency_links.txt 2023-02-23T17:05:30,212 writing requirements to src/flask_gcp_pubsub.egg-info/requires.txt 2023-02-23T17:05:30,214 writing top-level names to src/flask_gcp_pubsub.egg-info/top_level.txt 2023-02-23T17:05:30,230 reading manifest file 'src/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-23T17:05:30,232 adding license file 'LICENSE' 2023-02-23T17:05:30,234 writing manifest file 'src/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-23T17:05:30,331 Getting requirements to build wheel: finished with status 'done' 2023-02-23T17:05:30,340 Created temporary directory: /tmp/pip-modern-metadata-6_mdihz5 2023-02-23T17:05:30,343 Preparing metadata (pyproject.toml): started 2023-02-23T17:05:30,344 Running command Preparing metadata (pyproject.toml) 2023-02-23T17:05:30,863 /tmp/pip-build-env-oplpv9ip/overlay/lib/python3.9/site-packages/setuptools/config/_apply_pyprojecttoml.py:103: _WouldIgnoreField: 'readme' defined outside of `pyproject.toml` would be ignored. 2023-02-23T17:05:30,864 !! 2023-02-23T17:05:30,865 ########################################################################## 2023-02-23T17:05:30,865 # configuration would be ignored/result in error due to `pyproject.toml` # 2023-02-23T17:05:30,865 ########################################################################## 2023-02-23T17:05:30,865 The following seems to be defined outside of `pyproject.toml`: 2023-02-23T17:05:30,866 `readme = '# Flask GCP Pub/Sub\n\nLite distributed task queue using Google Cloud Platform (GCP) Pub/Sub\n\n[![PyPI version](https://img.shields.io/pypi/v/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![PyPI downloads](https://img.shields.io/pypi/dm/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![GNU GPLv3](https://img.shields.io/github/license/wildsys/flask-gcp-pubsub)](https://www.gnu.org/licenses/gpl-3.0.html)\n\n\n\n- [🤔 What does this package does?](#-what-does-this-package-does)\n- [🚀 Getting started](#-getting-started)\n - [Prerequisites](#prerequisites)\n - [Installation](#installation)\n - [Full example](#full-example)\n - [Bucket notification](#bucket-notification)\n - [Configuration](#configuration)\n- [🔮 Roadmap](#-roadmap)\n - [TO BE CONFIRMED](#to-be-confirmed)\n\n\n\n## 🤔 What does this package does?\n\nAs Celery, but in a lighter version, this package allows you to run operations asynchronously in your Flask project, but without the choice of the broker: it only uses GCP Pub/Sub.\n\nTechnically, this package can run without Flask, but, historically, it comes to have a quick-win for migrating to GCP Cloud Run using the Pub/Sub system, from an existing project using Flask + Celery.\n\nThis package aims to remove some painful tasks by:\n- Creating one dedicated topic for each function\n- Creating one dedicated reusable subscription for each function\n\nWe **do not recommand** this package for the following cases:\n- You need to reuse your development in a multi-cloud context\n- You have high volume of messages to process (not tested)\n\nThis package is given "as it", without garantees, under the GPLv3 License.\n\n## 🚀 Getting started\n\n### Prerequisites\n\n- A [Google Cloud account](https://console.cloud.google.com/)\n- A GCP project ([here to create a new one](https://console.cloud.google.com/projectcreate)), with [Pub/Sub API enabled](https://console.cloud.google.com/apis/library/pubsub.googleapis.com) (take care to select the good one)\n- A [Service Account](https://console.cloud.google.com/iam-admin/serviceaccounts) for which one you need a credential JSON file (`creds.json` in example below), with roles:\n - Pub/Sub Admin\n- A local environment with Python >= 3.9\n\n### Installation\n\n```python\npip install flask-gcp-pubsub\n```\n\n### Full example\n\n`demo.py`\n```python\n#!/usr/bin/env python\n# coding: utf-8\n\nfrom flask import Flask, make_response\nfrom flask_gcp_pubsub import PubSub\n\napp = Flask(__name__)\npubsub = PubSub(\n app,\n project_id=\'\',\n gcp_credentials_file=\'./creds.json\'\n)\n\n@pubsub.task\ndef my_task(msg1, msg2):\n """Awesome delayed execution"""\n print(\'test\', msg1, msg2)\n return \'ok\'\n\n@app.route(\'/test\')\ndef route_test():\n """Launch delayed execution"""\n my_task.delay(\'test1\', \'test2\')\n return make_response(\'ok\', 200)\n```\n\n**WARNING**: do not forget to replace `` with you GCP project ID (not number) and to downloed the JSON-formatted key from GCP Console.\n\n`wsgi.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import app\n\n# Start\nif __name__ == \'__main__\':\n app.run()\n```\n\n`wsgi_delayed.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import pubsub\n\n# Start\nif __name__ == \'__main__\':\n pubsub.run()\n```\n\nThis command will launch the Flask server:\n```shell\nflask run --port 9090\n```\n\nThis command will launch the asynchronous tasks manager:\n```shell\npython wsgi_delayed.py\n```\n\nYou can now navigate to http://localhost:9090/test\nAnd if everything goes OK, you just have to check the content of the output in console, which should look something like that:\n```\nStart consumers\nstatus=received message_id=6860318059876990 function=my_task\ntest test1 test2\nstatus=processed message_id=6860318059876990 function=my_task result=ok execution_time=6.818771362304688e-05\n```\n\n### Bucket notification\n\nYou can also create a task based on GCP Storage, by receiving a notification on any supported event from a bucket.\n\n```python\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_FINALIZE\'])\ndef my_bucket_notifications_create(*args, **kwargs):\n print(\'FINALIZE\', args, kwargs)\n\n\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_DELETE\'])\ndef my_bucket_notifications_delete(*args, **kwargs):\n print(\'DELETE\', args, kwargs)\n```\n\nFor the specific Storage product, Google create a specific Service Account for specific actions, that you cannot choose. [You can found it here.](https://console.cloud.google.com/storage/settings;tab=project_access)\n\nYou have to add the **Pub/Sub Admin** role for that particular Service Account in [IAM](https://console.cloud.google.com/iam-admin/iam).\n\nThe *kwargs* returns [all attributes of the Pub/Sub notification](https://cloud.google.com/storage/docs/pubsub-notifications#attributes).\n\nIf you change the function name, the auto-clean included at start-up cannot works. As you cannot excess 10 events per bucket, do not forget to clean previous subscription with commands:\n\n```shell\ngcloud storage buckets notifications list gs://\ngcloud storage buckets notifications delete gs://\n```\n\n### Configuration\n\nConfiguration can be done using keyword arguments in class instantiation and/or flask environment variable (set with `config.update`).\nIf both method used for one configuration key, the class instanciation is primary.\n\n| Flask env variable | Keyword argument | Usage | How-to get? |\n|-|-|-|-|\n| `PUBSUB_PROJECT_ID` | `project_id` | GCP project ID | See [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_JSON` | `gcp_credentials_json` | Service account credentials, as JSON string format | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_FILE` | `gcp_credentials_file` | Servicce account credentials, as JSON local file | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CONCURRENT_CONSUMERS` | `concurrent_consumers` | Number of simultaneous consumer (default: `4`) | |\n| `PUBSUB_CONCURRENT_MESSAGES` | `concurrent_messages` | Number of messages pull from topic per consumer per call (default: `2`) | |\n| `PUBSUB_TOPIC_PREFIX` | `topic_prefix` | Prefix for all topic used in the instance, useful for feature branches using same project. | |\n\n\n## 🔮 Roadmap\n\n- [ ] Priority in the treatment of messages per functions\n- [ ] Logging instead of print (+ option to format as JSON)\n- [ ] Contributing manual\n- [ ] Documentation about Flask configuration keys and their counterpart on PubSub direct call\n\n### TO BE CONFIRMED\n\n- [ ] Region selection (default: all regions) - can be edited in Storage Rules of Topic for the moment\n'` 2023-02-23T17:05:30,866 According to the spec (see the link below), however, setuptools CANNOT 2023-02-23T17:05:30,866 consider this value unless 'readme' is listed as `dynamic`. 2023-02-23T17:05:30,867 https://packaging.python.org/en/latest/specifications/declaring-project-metadata/ 2023-02-23T17:05:30,867 For the time being, `setuptools` will still consider the given value (as a 2023-02-23T17:05:30,867 **transitional** measure), but please note that future releases of setuptools will 2023-02-23T17:05:30,867 follow strictly the standard. 2023-02-23T17:05:30,867 To prevent this warning, you can list 'readme' under `dynamic` or alternatively 2023-02-23T17:05:30,868 remove the `[project]` table from your file and rely entirely on other means of 2023-02-23T17:05:30,868 configuration. 2023-02-23T17:05:30,868 !! 2023-02-23T17:05:30,868 warnings.warn(msg, _WouldIgnoreField) 2023-02-23T17:05:31,150 running dist_info 2023-02-23T17:05:31,156 creating /tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub.egg-info 2023-02-23T17:05:31,161 writing /tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub.egg-info/PKG-INFO 2023-02-23T17:05:31,163 writing dependency_links to /tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub.egg-info/dependency_links.txt 2023-02-23T17:05:31,166 writing requirements to /tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub.egg-info/requires.txt 2023-02-23T17:05:31,167 writing top-level names to /tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub.egg-info/top_level.txt 2023-02-23T17:05:31,169 writing manifest file '/tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-23T17:05:31,183 reading manifest file '/tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-23T17:05:31,185 adding license file 'LICENSE' 2023-02-23T17:05:31,187 writing manifest file '/tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-23T17:05:31,189 creating '/tmp/pip-modern-metadata-6_mdihz5/flask_gcp_pubsub-0.2.2.dist-info' 2023-02-23T17:05:31,323 Preparing metadata (pyproject.toml): finished with status 'done' 2023-02-23T17:05:31,331 Source in /tmp/pip-wheel-qaksfr0t/flask-gcp-pubsub_9c4c7b682a9b404995bb1d4edb868b4e has version 0.2.2, which satisfies requirement flask-gcp-pubsub==0.2.2 from https://files.pythonhosted.org/packages/e2/44/22d058e464c69d441c44c594708c80d4e73d058557620d3db7dfaf75db72/flask-gcp-pubsub-0.2.2.tar.gz 2023-02-23T17:05:31,332 Removed flask-gcp-pubsub==0.2.2 from https://files.pythonhosted.org/packages/e2/44/22d058e464c69d441c44c594708c80d4e73d058557620d3db7dfaf75db72/flask-gcp-pubsub-0.2.2.tar.gz from build tracker '/tmp/pip-build-tracker-kt_7i4go' 2023-02-23T17:05:31,338 Created temporary directory: /tmp/pip-unpack-sge0jjjo 2023-02-23T17:05:31,339 Building wheels for collected packages: flask-gcp-pubsub 2023-02-23T17:05:31,344 Created temporary directory: /tmp/pip-wheel-cdfwpz_x 2023-02-23T17:05:31,344 Destination directory: /tmp/pip-wheel-cdfwpz_x 2023-02-23T17:05:31,346 Building wheel for flask-gcp-pubsub (pyproject.toml): started 2023-02-23T17:05:31,347 Running command Building wheel for flask-gcp-pubsub (pyproject.toml) 2023-02-23T17:05:31,849 /tmp/pip-build-env-oplpv9ip/overlay/lib/python3.9/site-packages/setuptools/config/_apply_pyprojecttoml.py:103: _WouldIgnoreField: 'readme' defined outside of `pyproject.toml` would be ignored. 2023-02-23T17:05:31,850 !! 2023-02-23T17:05:31,850 ########################################################################## 2023-02-23T17:05:31,851 # configuration would be ignored/result in error due to `pyproject.toml` # 2023-02-23T17:05:31,851 ########################################################################## 2023-02-23T17:05:31,851 The following seems to be defined outside of `pyproject.toml`: 2023-02-23T17:05:31,851 `readme = '# Flask GCP Pub/Sub\n\nLite distributed task queue using Google Cloud Platform (GCP) Pub/Sub\n\n[![PyPI version](https://img.shields.io/pypi/v/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![PyPI downloads](https://img.shields.io/pypi/dm/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![GNU GPLv3](https://img.shields.io/github/license/wildsys/flask-gcp-pubsub)](https://www.gnu.org/licenses/gpl-3.0.html)\n\n\n\n- [🤔 What does this package does?](#-what-does-this-package-does)\n- [🚀 Getting started](#-getting-started)\n - [Prerequisites](#prerequisites)\n - [Installation](#installation)\n - [Full example](#full-example)\n - [Bucket notification](#bucket-notification)\n - [Configuration](#configuration)\n- [🔮 Roadmap](#-roadmap)\n - [TO BE CONFIRMED](#to-be-confirmed)\n\n\n\n## 🤔 What does this package does?\n\nAs Celery, but in a lighter version, this package allows you to run operations asynchronously in your Flask project, but without the choice of the broker: it only uses GCP Pub/Sub.\n\nTechnically, this package can run without Flask, but, historically, it comes to have a quick-win for migrating to GCP Cloud Run using the Pub/Sub system, from an existing project using Flask + Celery.\n\nThis package aims to remove some painful tasks by:\n- Creating one dedicated topic for each function\n- Creating one dedicated reusable subscription for each function\n\nWe **do not recommand** this package for the following cases:\n- You need to reuse your development in a multi-cloud context\n- You have high volume of messages to process (not tested)\n\nThis package is given "as it", without garantees, under the GPLv3 License.\n\n## 🚀 Getting started\n\n### Prerequisites\n\n- A [Google Cloud account](https://console.cloud.google.com/)\n- A GCP project ([here to create a new one](https://console.cloud.google.com/projectcreate)), with [Pub/Sub API enabled](https://console.cloud.google.com/apis/library/pubsub.googleapis.com) (take care to select the good one)\n- A [Service Account](https://console.cloud.google.com/iam-admin/serviceaccounts) for which one you need a credential JSON file (`creds.json` in example below), with roles:\n - Pub/Sub Admin\n- A local environment with Python >= 3.9\n\n### Installation\n\n```python\npip install flask-gcp-pubsub\n```\n\n### Full example\n\n`demo.py`\n```python\n#!/usr/bin/env python\n# coding: utf-8\n\nfrom flask import Flask, make_response\nfrom flask_gcp_pubsub import PubSub\n\napp = Flask(__name__)\npubsub = PubSub(\n app,\n project_id=\'\',\n gcp_credentials_file=\'./creds.json\'\n)\n\n@pubsub.task\ndef my_task(msg1, msg2):\n """Awesome delayed execution"""\n print(\'test\', msg1, msg2)\n return \'ok\'\n\n@app.route(\'/test\')\ndef route_test():\n """Launch delayed execution"""\n my_task.delay(\'test1\', \'test2\')\n return make_response(\'ok\', 200)\n```\n\n**WARNING**: do not forget to replace `` with you GCP project ID (not number) and to downloed the JSON-formatted key from GCP Console.\n\n`wsgi.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import app\n\n# Start\nif __name__ == \'__main__\':\n app.run()\n```\n\n`wsgi_delayed.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import pubsub\n\n# Start\nif __name__ == \'__main__\':\n pubsub.run()\n```\n\nThis command will launch the Flask server:\n```shell\nflask run --port 9090\n```\n\nThis command will launch the asynchronous tasks manager:\n```shell\npython wsgi_delayed.py\n```\n\nYou can now navigate to http://localhost:9090/test\nAnd if everything goes OK, you just have to check the content of the output in console, which should look something like that:\n```\nStart consumers\nstatus=received message_id=6860318059876990 function=my_task\ntest test1 test2\nstatus=processed message_id=6860318059876990 function=my_task result=ok execution_time=6.818771362304688e-05\n```\n\n### Bucket notification\n\nYou can also create a task based on GCP Storage, by receiving a notification on any supported event from a bucket.\n\n```python\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_FINALIZE\'])\ndef my_bucket_notifications_create(*args, **kwargs):\n print(\'FINALIZE\', args, kwargs)\n\n\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_DELETE\'])\ndef my_bucket_notifications_delete(*args, **kwargs):\n print(\'DELETE\', args, kwargs)\n```\n\nFor the specific Storage product, Google create a specific Service Account for specific actions, that you cannot choose. [You can found it here.](https://console.cloud.google.com/storage/settings;tab=project_access)\n\nYou have to add the **Pub/Sub Admin** role for that particular Service Account in [IAM](https://console.cloud.google.com/iam-admin/iam).\n\nThe *kwargs* returns [all attributes of the Pub/Sub notification](https://cloud.google.com/storage/docs/pubsub-notifications#attributes).\n\nIf you change the function name, the auto-clean included at start-up cannot works. As you cannot excess 10 events per bucket, do not forget to clean previous subscription with commands:\n\n```shell\ngcloud storage buckets notifications list gs://\ngcloud storage buckets notifications delete gs://\n```\n\n### Configuration\n\nConfiguration can be done using keyword arguments in class instantiation and/or flask environment variable (set with `config.update`).\nIf both method used for one configuration key, the class instanciation is primary.\n\n| Flask env variable | Keyword argument | Usage | How-to get? |\n|-|-|-|-|\n| `PUBSUB_PROJECT_ID` | `project_id` | GCP project ID | See [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_JSON` | `gcp_credentials_json` | Service account credentials, as JSON string format | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_FILE` | `gcp_credentials_file` | Servicce account credentials, as JSON local file | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CONCURRENT_CONSUMERS` | `concurrent_consumers` | Number of simultaneous consumer (default: `4`) | |\n| `PUBSUB_CONCURRENT_MESSAGES` | `concurrent_messages` | Number of messages pull from topic per consumer per call (default: `2`) | |\n| `PUBSUB_TOPIC_PREFIX` | `topic_prefix` | Prefix for all topic used in the instance, useful for feature branches using same project. | |\n\n\n## 🔮 Roadmap\n\n- [ ] Priority in the treatment of messages per functions\n- [ ] Logging instead of print (+ option to format as JSON)\n- [ ] Contributing manual\n- [ ] Documentation about Flask configuration keys and their counterpart on PubSub direct call\n\n### TO BE CONFIRMED\n\n- [ ] Region selection (default: all regions) - can be edited in Storage Rules of Topic for the moment\n'` 2023-02-23T17:05:31,852 According to the spec (see the link below), however, setuptools CANNOT 2023-02-23T17:05:31,852 consider this value unless 'readme' is listed as `dynamic`. 2023-02-23T17:05:31,852 https://packaging.python.org/en/latest/specifications/declaring-project-metadata/ 2023-02-23T17:05:31,853 For the time being, `setuptools` will still consider the given value (as a 2023-02-23T17:05:31,853 **transitional** measure), but please note that future releases of setuptools will 2023-02-23T17:05:31,853 follow strictly the standard. 2023-02-23T17:05:31,853 To prevent this warning, you can list 'readme' under `dynamic` or alternatively 2023-02-23T17:05:31,853 remove the `[project]` table from your file and rely entirely on other means of 2023-02-23T17:05:31,853 configuration. 2023-02-23T17:05:31,854 !! 2023-02-23T17:05:31,854 warnings.warn(msg, _WouldIgnoreField) 2023-02-23T17:05:32,113 running bdist_wheel 2023-02-23T17:05:32,128 running build 2023-02-23T17:05:32,128 running build_py 2023-02-23T17:05:32,133 creating build 2023-02-23T17:05:32,134 creating build/lib 2023-02-23T17:05:32,135 creating build/lib/flask_gcp_pubsub 2023-02-23T17:05:32,136 copying src/flask_gcp_pubsub/__init__.py -> build/lib/flask_gcp_pubsub 2023-02-23T17:05:32,138 copying src/flask_gcp_pubsub/storage.py -> build/lib/flask_gcp_pubsub 2023-02-23T17:05:32,140 copying src/flask_gcp_pubsub/pubsub.py -> build/lib/flask_gcp_pubsub 2023-02-23T17:05:32,142 copying src/flask_gcp_pubsub/publisher.py -> build/lib/flask_gcp_pubsub 2023-02-23T17:05:32,144 running egg_info 2023-02-23T17:05:32,152 writing src/flask_gcp_pubsub.egg-info/PKG-INFO 2023-02-23T17:05:32,155 writing dependency_links to src/flask_gcp_pubsub.egg-info/dependency_links.txt 2023-02-23T17:05:32,156 writing requirements to src/flask_gcp_pubsub.egg-info/requires.txt 2023-02-23T17:05:32,157 writing top-level names to src/flask_gcp_pubsub.egg-info/top_level.txt 2023-02-23T17:05:32,165 reading manifest file 'src/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-23T17:05:32,167 adding license file 'LICENSE' 2023-02-23T17:05:32,169 writing manifest file 'src/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-23T17:05:32,178 installing to build/bdist.linux-armv7l/wheel 2023-02-23T17:05:32,179 running install 2023-02-23T17:05:32,204 running install_lib 2023-02-23T17:05:32,208 creating build/bdist.linux-armv7l 2023-02-23T17:05:32,209 creating build/bdist.linux-armv7l/wheel 2023-02-23T17:05:32,211 creating build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-23T17:05:32,212 copying build/lib/flask_gcp_pubsub/__init__.py -> build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-23T17:05:32,214 copying build/lib/flask_gcp_pubsub/storage.py -> build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-23T17:05:32,216 copying build/lib/flask_gcp_pubsub/pubsub.py -> build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-23T17:05:32,219 copying build/lib/flask_gcp_pubsub/publisher.py -> build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-23T17:05:32,221 running install_egg_info 2023-02-23T17:05:32,225 Copying src/flask_gcp_pubsub.egg-info to build/bdist.linux-armv7l/wheel/flask_gcp_pubsub-0.2.2-py3.9.egg-info 2023-02-23T17:05:32,237 running install_scripts 2023-02-23T17:05:32,256 creating build/bdist.linux-armv7l/wheel/flask_gcp_pubsub-0.2.2.dist-info/WHEEL 2023-02-23T17:05:32,259 creating '/tmp/pip-wheel-cdfwpz_x/.tmp-dsg9kfac/flask_gcp_pubsub-0.2.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-02-23T17:05:32,261 adding 'flask_gcp_pubsub/__init__.py' 2023-02-23T17:05:32,263 adding 'flask_gcp_pubsub/publisher.py' 2023-02-23T17:05:32,265 adding 'flask_gcp_pubsub/pubsub.py' 2023-02-23T17:05:32,266 adding 'flask_gcp_pubsub/storage.py' 2023-02-23T17:05:32,273 adding 'flask_gcp_pubsub-0.2.2.dist-info/LICENSE' 2023-02-23T17:05:32,275 adding 'flask_gcp_pubsub-0.2.2.dist-info/METADATA' 2023-02-23T17:05:32,276 adding 'flask_gcp_pubsub-0.2.2.dist-info/WHEEL' 2023-02-23T17:05:32,277 adding 'flask_gcp_pubsub-0.2.2.dist-info/top_level.txt' 2023-02-23T17:05:32,278 adding 'flask_gcp_pubsub-0.2.2.dist-info/RECORD' 2023-02-23T17:05:32,280 removing build/bdist.linux-armv7l/wheel 2023-02-23T17:05:32,382 Building wheel for flask-gcp-pubsub (pyproject.toml): finished with status 'done' 2023-02-23T17:05:32,390 Created wheel for flask-gcp-pubsub: filename=flask_gcp_pubsub-0.2.2-py3-none-any.whl size=20106 sha256=542f99287ca41322215ffcd8396d79e3ed4cb5942eb32c457cb4395183ea3754 2023-02-23T17:05:32,391 Stored in directory: /tmp/pip-ephem-wheel-cache-s_v156kc/wheels/ef/74/3e/137f2421701f58b3cf259290bffcdadf37b59b9ddca6c67c0b 2023-02-23T17:05:32,404 Successfully built flask-gcp-pubsub 2023-02-23T17:05:32,407 Removed build tracker: '/tmp/pip-build-tracker-kt_7i4go'