2023-02-21T18:57:15,386 Created temporary directory: /tmp/pip-ephem-wheel-cache-vd0dfklx 2023-02-21T18:57:15,389 Created temporary directory: /tmp/pip-build-tracker-e71c_ay4 2023-02-21T18:57:15,390 Initialized build tracking at /tmp/pip-build-tracker-e71c_ay4 2023-02-21T18:57:15,390 Created build tracker: /tmp/pip-build-tracker-e71c_ay4 2023-02-21T18:57:15,390 Entered build tracker: /tmp/pip-build-tracker-e71c_ay4 2023-02-21T18:57:15,391 Created temporary directory: /tmp/pip-wheel-7gdigzf4 2023-02-21T18:57:15,395 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-02-21T18:57:15,398 Created temporary directory: /tmp/pip-ephem-wheel-cache-0va7i_5u 2023-02-21T18:57:15,429 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-02-21T18:57:15,432 2 location(s) to search for versions of flask-gcp-pubsub: 2023-02-21T18:57:15,432 * https://pypi.org/simple/flask-gcp-pubsub/ 2023-02-21T18:57:15,432 * https://www.piwheels.org/simple/flask-gcp-pubsub/ 2023-02-21T18:57:15,432 Fetching project page and analyzing links: https://pypi.org/simple/flask-gcp-pubsub/ 2023-02-21T18:57:15,433 Getting page https://pypi.org/simple/flask-gcp-pubsub/ 2023-02-21T18:57:15,435 Found index url https://pypi.org/simple 2023-02-21T18:57:15,487 Fetched page https://pypi.org/simple/flask-gcp-pubsub/ as application/vnd.pypi.simple.v1+json 2023-02-21T18:57:15,491 Found link https://files.pythonhosted.org/packages/86/31/f5c0b0a70ee4d7c459bff74edf868ebe4c3311dd6d1dc535cb1a6fd24839/flask-gcp-pubsub-0.0.0.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.0.0 2023-02-21T18:57:15,491 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/df/fe/187a54cb034585f0abe1d20c5cb4aaaf42e29cb930da9f7c0be19dcef9bd/flask_gcp_pubsub-0.0.0-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,491 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/dd/5d/2d880d93e3d6974f8d979bae7edd9eecf4b1b8c3b8151af857beef431435/flask_gcp_pubsub-0.1.0-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,492 Found link https://files.pythonhosted.org/packages/af/63/e087cee3bb381340c63abae72693e15b6886816651c2175c7771c3e395de/flask-gcp-pubsub-0.1.1.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.1.1 2023-02-21T18:57:15,492 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/31/82/5003e5fe58dfdd54e0e165d3e4a3e3c365923130b737dc13a15b7b84c009/flask_gcp_pubsub-0.1.1-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,493 Found link https://files.pythonhosted.org/packages/8f/7d/e18e9635401330bc156bfe087716e0f3244d5c3c50a9515415b262b9574f/flask-gcp-pubsub-0.1.2.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.1.2 2023-02-21T18:57:15,493 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/78/cd/601af34e8214c3df745b3e53cbfd7b97d6b1671a0cd04656f1dff85d1430/flask_gcp_pubsub-0.1.2-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,493 Found link https://files.pythonhosted.org/packages/ca/e1/f5ea6e88d9c73bef5c1930ff049f0cbc4eecc2a064e603978239b0e5a112/flask-gcp-pubsub-0.2.0.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.2.0 2023-02-21T18:57:15,494 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/c3/eb/d2d31a4a47508e34ffc44b5aba4931f6134f2332de3c32ac121e004f4d88/flask_gcp_pubsub-0.2.0-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,494 Found link https://files.pythonhosted.org/packages/42/50/b0f9451c844df9633bce784ae62e3ed22321311e6947976b0444d5d48264/flask-gcp-pubsub-0.2.1.tar.gz (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9), version: 0.2.1 2023-02-21T18:57:15,494 Skipping link: No binaries permitted for flask-gcp-pubsub: https://files.pythonhosted.org/packages/8f/43/d6a1e9e73f70458587f4d20142413c8a26062f34752ea0312bd5b9689d35/flask_gcp_pubsub-0.2.1-py3-none-any.whl (from https://pypi.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,495 Fetching project page and analyzing links: https://www.piwheels.org/simple/flask-gcp-pubsub/ 2023-02-21T18:57:15,495 Getting page https://www.piwheels.org/simple/flask-gcp-pubsub/ 2023-02-21T18:57:15,496 Found index url https://www.piwheels.org/simple 2023-02-21T18:57:15,698 Fetched page https://www.piwheels.org/simple/flask-gcp-pubsub/ as text/html 2023-02-21T18:57:15,700 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.2.0-py3-none-any.whl#sha256=09f9b0d31963f2cac92d927cfc7fe935e346abef0a6a4662198442eeedb74ba8 (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,701 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.1.2-py3-none-any.whl#sha256=c7af52c9e03268207a069fb9977052054bbeff82d2bba29490d3a70c0d68ad3e (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,701 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.1.1-py3-none-any.whl#sha256=c1fa0b3cd09351a7d90d1d79b52a5c796e0d9649c0578297467820b6432f7b48 (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,701 Skipping link: No binaries permitted for flask-gcp-pubsub: https://www.piwheels.org/simple/flask-gcp-pubsub/flask_gcp_pubsub-0.0.0-py3-none-any.whl#sha256=00de094418db500b7a05819cc68496778fcd13b0f6c0108549b87f81b96fa4a8 (from https://www.piwheels.org/simple/flask-gcp-pubsub/) (requires-python:>=3.9) 2023-02-21T18:57:15,701 Skipping link: not a file: https://www.piwheels.org/simple/flask-gcp-pubsub/ 2023-02-21T18:57:15,701 Skipping link: not a file: https://pypi.org/simple/flask-gcp-pubsub/ 2023-02-21T18:57:15,719 Given no hashes to check 1 links for project 'flask-gcp-pubsub': discarding no candidates 2023-02-21T18:57:15,734 Collecting flask-gcp-pubsub==0.2.1 2023-02-21T18:57:15,736 Created temporary directory: /tmp/pip-unpack-58olj2f4 2023-02-21T18:57:15,924 Downloading flask-gcp-pubsub-0.2.1.tar.gz (21 kB) 2023-02-21T18:57:15,968 Added flask-gcp-pubsub==0.2.1 from https://files.pythonhosted.org/packages/42/50/b0f9451c844df9633bce784ae62e3ed22321311e6947976b0444d5d48264/flask-gcp-pubsub-0.2.1.tar.gz to build tracker '/tmp/pip-build-tracker-e71c_ay4' 2023-02-21T18:57:15,973 Created temporary directory: /tmp/pip-build-env-1714h1rn 2023-02-21T18:57:15,983 Installing build dependencies: started 2023-02-21T18:57:15,984 Running command pip subprocess to install build dependencies 2023-02-21T18:57:17,204 Using pip 23.0.1 from /usr/local/lib/python3.9/dist-packages/pip (python 3.9) 2023-02-21T18:57:17,812 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-02-21T18:57:17,841 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-02-21T18:57:19,487 Collecting setuptools>=61.0.0 2023-02-21T18:57:19,598 Using cached https://www.piwheels.org/simple/setuptools/setuptools-67.3.3-py3-none-any.whl (1.1 MB) 2023-02-21T18:57:19,858 Collecting wheel 2023-02-21T18:57:19,877 Using cached https://www.piwheels.org/simple/wheel/wheel-0.38.4-py3-none-any.whl (36 kB) 2023-02-21T18:57:21,653 Installing collected packages: wheel, setuptools 2023-02-21T18:57:21,801 Creating /tmp/pip-build-env-1714h1rn/overlay/bin 2023-02-21T18:57:21,804 changing mode of /tmp/pip-build-env-1714h1rn/overlay/bin/wheel to 755 2023-02-21T18:57:24,019 Successfully installed setuptools-67.3.3 wheel-0.38.4 2023-02-21T18:57:24,529 Installing build dependencies: finished with status 'done' 2023-02-21T18:57:24,535 Getting requirements to build wheel: started 2023-02-21T18:57:24,536 Running command Getting requirements to build wheel 2023-02-21T18:57:25,096 /tmp/pip-build-env-1714h1rn/overlay/lib/python3.9/site-packages/setuptools/config/_apply_pyprojecttoml.py:103: _WouldIgnoreField: 'readme' defined outside of `pyproject.toml` would be ignored. 2023-02-21T18:57:25,097 !! 2023-02-21T18:57:25,097 ########################################################################## 2023-02-21T18:57:25,098 # configuration would be ignored/result in error due to `pyproject.toml` # 2023-02-21T18:57:25,098 ########################################################################## 2023-02-21T18:57:25,098 The following seems to be defined outside of `pyproject.toml`: 2023-02-21T18:57:25,099 `readme = '# Flask GCP Pub/Sub\n\nLite distributed task queue using Google Cloud Platform (GCP) Pub/Sub\n\n[![PyPI version](https://img.shields.io/pypi/v/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![PyPI downloads](https://img.shields.io/pypi/dm/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![GNU GPLv3](https://img.shields.io/github/license/wildsys/flask-gcp-pubsub)](https://www.gnu.org/licenses/gpl-3.0.html)\n\n\n\n- [🤔 What does this package does?](#-what-does-this-package-does)\n- [🚀 Getting started](#-getting-started)\n - [Prerequisites](#prerequisites)\n - [Installation](#installation)\n - [Full example](#full-example)\n - [Bucket notification](#bucket-notification)\n - [Configuration](#configuration)\n- [🔮 Roadmap](#-roadmap)\n - [TO BE CONFIRMED](#to-be-confirmed)\n\n\n\n## 🤔 What does this package does?\n\nAs Celery, but in a lighter version, this package allows you to run operations asynchronously in your Flask project, but without the choice of the broker: it only uses GCP Pub/Sub.\n\nTechnically, this package can run without Flask, but, historically, it comes to have a quick-win for migrating to GCP Cloud Run using the Pub/Sub system, from an existing project using Flask + Celery.\n\nThis package aims to remove some painful tasks by:\n- Creating one dedicated topic for each function\n- Creating one dedicated reusable subscription for each function\n\nWe **do not recommand** this package for the following cases:\n- You need to reuse your development in a multi-cloud context\n- You have high volume of messages to process (not tested)\n\nThis package is given "as it", without garantees, under the GPLv3 License.\n\n## 🚀 Getting started\n\n### Prerequisites\n\n- A [Google Cloud account](https://console.cloud.google.com/)\n- A GCP project ([here to create a new one](https://console.cloud.google.com/projectcreate)), with [Pub/Sub API enabled](https://console.cloud.google.com/apis/library/pubsub.googleapis.com) (take care to select the good one)\n- A [Service Account](https://console.cloud.google.com/iam-admin/serviceaccounts) for which one you need a credential JSON file (`creds.json` in example below), with roles:\n - Pub/Sub Admin\n- A local environment with Python >= 3.9\n\n### Installation\n\n```python\npip install flask-gcp-pubsub\n```\n\n### Full example\n\n`demo.py`\n```python\n#!/usr/bin/env python\n# coding: utf-8\n\nfrom flask import Flask, make_response\nfrom flask_gcp_pubsub import PubSub\n\napp = Flask(__name__)\npubsub = PubSub(\n app,\n project_id=\'\',\n gcp_credentials_file=\'./creds.json\'\n)\n\n@pubsub.task\ndef my_task(msg1, msg2):\n """Awesome delayed execution"""\n print(\'test\', msg1, msg2)\n return \'ok\'\n\n@app.route(\'/test\')\ndef route_test():\n """Launch delayed execution"""\n my_task.delay(\'test1\', \'test2\')\n return make_response(\'ok\', 200)\n```\n\n**WARNING**: do not forget to replace `` with you GCP project ID (not number) and to downloed the JSON-formatted key from GCP Console.\n\n`wsgi.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import app\n\n# Start\nif __name__ == \'__main__\':\n app.run()\n```\n\n`wsgi_delayed.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import pubsub\n\n# Start\nif __name__ == \'__main__\':\n pubsub.run()\n```\n\nThis command will launch the Flask server:\n```shell\nflask run --port 9090\n```\n\nThis command will launch the asynchronous tasks manager:\n```shell\npython wsgi_delayed.py\n```\n\nYou can now navigate to http://localhost:9090/test\nAnd if everything goes OK, you just have to check the content of the output in console, which should look something like that:\n```\nStart consumers\nstatus=received message_id=6860318059876990 function=my_task\ntest test1 test2\nstatus=processed message_id=6860318059876990 function=my_task result=ok execution_time=6.818771362304688e-05\n```\n\n### Bucket notification\n\nYou can also create a task based on GCP Storage, by receiving a notification on any supported event from a bucket.\n\n```python\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_FINALIZE\'])\ndef my_bucket_notifications_create(*args, **kwargs):\n print(\'FINALIZE\', args, kwargs)\n\n\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_DELETE\'])\ndef my_bucket_notifications_delete(*args, **kwargs):\n print(\'DELETE\', args, kwargs)\n```\n\nFor the specific Storage product, Google create a specific Service Account for specific actions, that you cannot choose. [You can found it here.](https://console.cloud.google.com/storage/settings;tab=project_access)\n\nYou have to add the **Pub/Sub Admin** role for that particular Service Account in [IAM](https://console.cloud.google.com/iam-admin/iam).\n\nThe *kwargs* returns [all attributes of the Pub/Sub notification](https://cloud.google.com/storage/docs/pubsub-notifications#attributes).\n\nIf you change the function name, the auto-clean included at start-up cannot works. As you cannot excess 10 events per bucket, do not forget to clean previous subscription with commands:\n\n```shell\ngcloud storage buckets notifications list gs://\ngcloud storage buckets notifications delete gs://\n```\n\n### Configuration\n\nConfiguration can be done using keyword arguments in class instantiation and/or flask environment variable (set with `config.update`).\nIf both method used for one configuration key, the class instanciation is primary.\n\n| Flask env variable | Keyword argument | Usage | How-to get? |\n|-|-|-|-|\n| `PUBSUB_PROJECT_ID` | `project_id` | GCP project ID | See [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_JSON` | `gcp_credentials_json` | Service account credentials, as JSON string format | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_FILE` | `gcp_credentials_file` | Servicce account credentials, as JSON local file | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CONCURRENT_CONSUMERS` | `concurrent_consumers` | Number of simultaneous consumer (default: `4`) | |\n| `PUBSUB_CONCURRENT_MESSAGES` | `concurrent_messages` | Number of messages pull from topic per consumer per call (default: `2`) | |\n| `PUBSUB_TOPIC_PREFIX` | `topic_prefix` | Prefix for all topic used in the instance, useful for feature branches using same project. | |\n\n\n## 🔮 Roadmap\n\n- [ ] Priority in the treatment of messages per functions\n- [ ] Logging instead of print (+ option to format as JSON)\n- [ ] Contributing manual\n- [ ] Documentation about Flask configuration keys and their counterpart on PubSub direct call\n\n### TO BE CONFIRMED\n\n- [ ] Region selection (default: all regions) - can be edited in Storage Rules of Topic for the moment\n'` 2023-02-21T18:57:25,099 According to the spec (see the link below), however, setuptools CANNOT 2023-02-21T18:57:25,099 consider this value unless 'readme' is listed as `dynamic`. 2023-02-21T18:57:25,099 https://packaging.python.org/en/latest/specifications/declaring-project-metadata/ 2023-02-21T18:57:25,100 For the time being, `setuptools` will still consider the given value (as a 2023-02-21T18:57:25,100 **transitional** measure), but please note that future releases of setuptools will 2023-02-21T18:57:25,100 follow strictly the standard. 2023-02-21T18:57:25,100 To prevent this warning, you can list 'readme' under `dynamic` or alternatively 2023-02-21T18:57:25,100 remove the `[project]` table from your file and rely entirely on other means of 2023-02-21T18:57:25,100 configuration. 2023-02-21T18:57:25,101 !! 2023-02-21T18:57:25,101 warnings.warn(msg, _WouldIgnoreField) 2023-02-21T18:57:25,391 running egg_info 2023-02-21T18:57:25,396 writing src/flask_gcp_pubsub.egg-info/PKG-INFO 2023-02-21T18:57:25,398 writing dependency_links to src/flask_gcp_pubsub.egg-info/dependency_links.txt 2023-02-21T18:57:25,401 writing requirements to src/flask_gcp_pubsub.egg-info/requires.txt 2023-02-21T18:57:25,402 writing top-level names to src/flask_gcp_pubsub.egg-info/top_level.txt 2023-02-21T18:57:25,418 reading manifest file 'src/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-21T18:57:25,420 adding license file 'LICENSE' 2023-02-21T18:57:25,422 writing manifest file 'src/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-21T18:57:25,522 Getting requirements to build wheel: finished with status 'done' 2023-02-21T18:57:25,532 Created temporary directory: /tmp/pip-modern-metadata-v4u_fznn 2023-02-21T18:57:25,535 Preparing metadata (pyproject.toml): started 2023-02-21T18:57:25,536 Running command Preparing metadata (pyproject.toml) 2023-02-21T18:57:26,049 /tmp/pip-build-env-1714h1rn/overlay/lib/python3.9/site-packages/setuptools/config/_apply_pyprojecttoml.py:103: _WouldIgnoreField: 'readme' defined outside of `pyproject.toml` would be ignored. 2023-02-21T18:57:26,050 !! 2023-02-21T18:57:26,051 ########################################################################## 2023-02-21T18:57:26,051 # configuration would be ignored/result in error due to `pyproject.toml` # 2023-02-21T18:57:26,051 ########################################################################## 2023-02-21T18:57:26,051 The following seems to be defined outside of `pyproject.toml`: 2023-02-21T18:57:26,052 `readme = '# Flask GCP Pub/Sub\n\nLite distributed task queue using Google Cloud Platform (GCP) Pub/Sub\n\n[![PyPI version](https://img.shields.io/pypi/v/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![PyPI downloads](https://img.shields.io/pypi/dm/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![GNU GPLv3](https://img.shields.io/github/license/wildsys/flask-gcp-pubsub)](https://www.gnu.org/licenses/gpl-3.0.html)\n\n\n\n- [🤔 What does this package does?](#-what-does-this-package-does)\n- [🚀 Getting started](#-getting-started)\n - [Prerequisites](#prerequisites)\n - [Installation](#installation)\n - [Full example](#full-example)\n - [Bucket notification](#bucket-notification)\n - [Configuration](#configuration)\n- [🔮 Roadmap](#-roadmap)\n - [TO BE CONFIRMED](#to-be-confirmed)\n\n\n\n## 🤔 What does this package does?\n\nAs Celery, but in a lighter version, this package allows you to run operations asynchronously in your Flask project, but without the choice of the broker: it only uses GCP Pub/Sub.\n\nTechnically, this package can run without Flask, but, historically, it comes to have a quick-win for migrating to GCP Cloud Run using the Pub/Sub system, from an existing project using Flask + Celery.\n\nThis package aims to remove some painful tasks by:\n- Creating one dedicated topic for each function\n- Creating one dedicated reusable subscription for each function\n\nWe **do not recommand** this package for the following cases:\n- You need to reuse your development in a multi-cloud context\n- You have high volume of messages to process (not tested)\n\nThis package is given "as it", without garantees, under the GPLv3 License.\n\n## 🚀 Getting started\n\n### Prerequisites\n\n- A [Google Cloud account](https://console.cloud.google.com/)\n- A GCP project ([here to create a new one](https://console.cloud.google.com/projectcreate)), with [Pub/Sub API enabled](https://console.cloud.google.com/apis/library/pubsub.googleapis.com) (take care to select the good one)\n- A [Service Account](https://console.cloud.google.com/iam-admin/serviceaccounts) for which one you need a credential JSON file (`creds.json` in example below), with roles:\n - Pub/Sub Admin\n- A local environment with Python >= 3.9\n\n### Installation\n\n```python\npip install flask-gcp-pubsub\n```\n\n### Full example\n\n`demo.py`\n```python\n#!/usr/bin/env python\n# coding: utf-8\n\nfrom flask import Flask, make_response\nfrom flask_gcp_pubsub import PubSub\n\napp = Flask(__name__)\npubsub = PubSub(\n app,\n project_id=\'\',\n gcp_credentials_file=\'./creds.json\'\n)\n\n@pubsub.task\ndef my_task(msg1, msg2):\n """Awesome delayed execution"""\n print(\'test\', msg1, msg2)\n return \'ok\'\n\n@app.route(\'/test\')\ndef route_test():\n """Launch delayed execution"""\n my_task.delay(\'test1\', \'test2\')\n return make_response(\'ok\', 200)\n```\n\n**WARNING**: do not forget to replace `` with you GCP project ID (not number) and to downloed the JSON-formatted key from GCP Console.\n\n`wsgi.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import app\n\n# Start\nif __name__ == \'__main__\':\n app.run()\n```\n\n`wsgi_delayed.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import pubsub\n\n# Start\nif __name__ == \'__main__\':\n pubsub.run()\n```\n\nThis command will launch the Flask server:\n```shell\nflask run --port 9090\n```\n\nThis command will launch the asynchronous tasks manager:\n```shell\npython wsgi_delayed.py\n```\n\nYou can now navigate to http://localhost:9090/test\nAnd if everything goes OK, you just have to check the content of the output in console, which should look something like that:\n```\nStart consumers\nstatus=received message_id=6860318059876990 function=my_task\ntest test1 test2\nstatus=processed message_id=6860318059876990 function=my_task result=ok execution_time=6.818771362304688e-05\n```\n\n### Bucket notification\n\nYou can also create a task based on GCP Storage, by receiving a notification on any supported event from a bucket.\n\n```python\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_FINALIZE\'])\ndef my_bucket_notifications_create(*args, **kwargs):\n print(\'FINALIZE\', args, kwargs)\n\n\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_DELETE\'])\ndef my_bucket_notifications_delete(*args, **kwargs):\n print(\'DELETE\', args, kwargs)\n```\n\nFor the specific Storage product, Google create a specific Service Account for specific actions, that you cannot choose. [You can found it here.](https://console.cloud.google.com/storage/settings;tab=project_access)\n\nYou have to add the **Pub/Sub Admin** role for that particular Service Account in [IAM](https://console.cloud.google.com/iam-admin/iam).\n\nThe *kwargs* returns [all attributes of the Pub/Sub notification](https://cloud.google.com/storage/docs/pubsub-notifications#attributes).\n\nIf you change the function name, the auto-clean included at start-up cannot works. As you cannot excess 10 events per bucket, do not forget to clean previous subscription with commands:\n\n```shell\ngcloud storage buckets notifications list gs://\ngcloud storage buckets notifications delete gs://\n```\n\n### Configuration\n\nConfiguration can be done using keyword arguments in class instantiation and/or flask environment variable (set with `config.update`).\nIf both method used for one configuration key, the class instanciation is primary.\n\n| Flask env variable | Keyword argument | Usage | How-to get? |\n|-|-|-|-|\n| `PUBSUB_PROJECT_ID` | `project_id` | GCP project ID | See [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_JSON` | `gcp_credentials_json` | Service account credentials, as JSON string format | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_FILE` | `gcp_credentials_file` | Servicce account credentials, as JSON local file | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CONCURRENT_CONSUMERS` | `concurrent_consumers` | Number of simultaneous consumer (default: `4`) | |\n| `PUBSUB_CONCURRENT_MESSAGES` | `concurrent_messages` | Number of messages pull from topic per consumer per call (default: `2`) | |\n| `PUBSUB_TOPIC_PREFIX` | `topic_prefix` | Prefix for all topic used in the instance, useful for feature branches using same project. | |\n\n\n## 🔮 Roadmap\n\n- [ ] Priority in the treatment of messages per functions\n- [ ] Logging instead of print (+ option to format as JSON)\n- [ ] Contributing manual\n- [ ] Documentation about Flask configuration keys and their counterpart on PubSub direct call\n\n### TO BE CONFIRMED\n\n- [ ] Region selection (default: all regions) - can be edited in Storage Rules of Topic for the moment\n'` 2023-02-21T18:57:26,052 According to the spec (see the link below), however, setuptools CANNOT 2023-02-21T18:57:26,052 consider this value unless 'readme' is listed as `dynamic`. 2023-02-21T18:57:26,053 https://packaging.python.org/en/latest/specifications/declaring-project-metadata/ 2023-02-21T18:57:26,053 For the time being, `setuptools` will still consider the given value (as a 2023-02-21T18:57:26,053 **transitional** measure), but please note that future releases of setuptools will 2023-02-21T18:57:26,053 follow strictly the standard. 2023-02-21T18:57:26,053 To prevent this warning, you can list 'readme' under `dynamic` or alternatively 2023-02-21T18:57:26,054 remove the `[project]` table from your file and rely entirely on other means of 2023-02-21T18:57:26,054 configuration. 2023-02-21T18:57:26,054 !! 2023-02-21T18:57:26,054 warnings.warn(msg, _WouldIgnoreField) 2023-02-21T18:57:26,329 running dist_info 2023-02-21T18:57:26,334 creating /tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub.egg-info 2023-02-21T18:57:26,338 writing /tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub.egg-info/PKG-INFO 2023-02-21T18:57:26,342 writing dependency_links to /tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub.egg-info/dependency_links.txt 2023-02-21T18:57:26,344 writing requirements to /tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub.egg-info/requires.txt 2023-02-21T18:57:26,345 writing top-level names to /tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub.egg-info/top_level.txt 2023-02-21T18:57:26,347 writing manifest file '/tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-21T18:57:26,360 reading manifest file '/tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-21T18:57:26,363 adding license file 'LICENSE' 2023-02-21T18:57:26,365 writing manifest file '/tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-21T18:57:26,366 creating '/tmp/pip-modern-metadata-v4u_fznn/flask_gcp_pubsub-0.2.1.dist-info' 2023-02-21T18:57:26,501 Preparing metadata (pyproject.toml): finished with status 'done' 2023-02-21T18:57:26,509 Source in /tmp/pip-wheel-7gdigzf4/flask-gcp-pubsub_432ef59f5b394b1aad813b5a0553679d has version 0.2.1, which satisfies requirement flask-gcp-pubsub==0.2.1 from https://files.pythonhosted.org/packages/42/50/b0f9451c844df9633bce784ae62e3ed22321311e6947976b0444d5d48264/flask-gcp-pubsub-0.2.1.tar.gz 2023-02-21T18:57:26,510 Removed flask-gcp-pubsub==0.2.1 from https://files.pythonhosted.org/packages/42/50/b0f9451c844df9633bce784ae62e3ed22321311e6947976b0444d5d48264/flask-gcp-pubsub-0.2.1.tar.gz from build tracker '/tmp/pip-build-tracker-e71c_ay4' 2023-02-21T18:57:26,517 Created temporary directory: /tmp/pip-unpack-dtzxma60 2023-02-21T18:57:26,517 Building wheels for collected packages: flask-gcp-pubsub 2023-02-21T18:57:26,522 Created temporary directory: /tmp/pip-wheel-r7n67ufn 2023-02-21T18:57:26,522 Destination directory: /tmp/pip-wheel-r7n67ufn 2023-02-21T18:57:26,525 Building wheel for flask-gcp-pubsub (pyproject.toml): started 2023-02-21T18:57:26,526 Running command Building wheel for flask-gcp-pubsub (pyproject.toml) 2023-02-21T18:57:27,032 /tmp/pip-build-env-1714h1rn/overlay/lib/python3.9/site-packages/setuptools/config/_apply_pyprojecttoml.py:103: _WouldIgnoreField: 'readme' defined outside of `pyproject.toml` would be ignored. 2023-02-21T18:57:27,033 !! 2023-02-21T18:57:27,034 ########################################################################## 2023-02-21T18:57:27,034 # configuration would be ignored/result in error due to `pyproject.toml` # 2023-02-21T18:57:27,034 ########################################################################## 2023-02-21T18:57:27,034 The following seems to be defined outside of `pyproject.toml`: 2023-02-21T18:57:27,035 `readme = '# Flask GCP Pub/Sub\n\nLite distributed task queue using Google Cloud Platform (GCP) Pub/Sub\n\n[![PyPI version](https://img.shields.io/pypi/v/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![PyPI downloads](https://img.shields.io/pypi/dm/flask-gcp-pubsub)](https://github.com/wildsys/flask-gcp-pubsub) [![GNU GPLv3](https://img.shields.io/github/license/wildsys/flask-gcp-pubsub)](https://www.gnu.org/licenses/gpl-3.0.html)\n\n\n\n- [🤔 What does this package does?](#-what-does-this-package-does)\n- [🚀 Getting started](#-getting-started)\n - [Prerequisites](#prerequisites)\n - [Installation](#installation)\n - [Full example](#full-example)\n - [Bucket notification](#bucket-notification)\n - [Configuration](#configuration)\n- [🔮 Roadmap](#-roadmap)\n - [TO BE CONFIRMED](#to-be-confirmed)\n\n\n\n## 🤔 What does this package does?\n\nAs Celery, but in a lighter version, this package allows you to run operations asynchronously in your Flask project, but without the choice of the broker: it only uses GCP Pub/Sub.\n\nTechnically, this package can run without Flask, but, historically, it comes to have a quick-win for migrating to GCP Cloud Run using the Pub/Sub system, from an existing project using Flask + Celery.\n\nThis package aims to remove some painful tasks by:\n- Creating one dedicated topic for each function\n- Creating one dedicated reusable subscription for each function\n\nWe **do not recommand** this package for the following cases:\n- You need to reuse your development in a multi-cloud context\n- You have high volume of messages to process (not tested)\n\nThis package is given "as it", without garantees, under the GPLv3 License.\n\n## 🚀 Getting started\n\n### Prerequisites\n\n- A [Google Cloud account](https://console.cloud.google.com/)\n- A GCP project ([here to create a new one](https://console.cloud.google.com/projectcreate)), with [Pub/Sub API enabled](https://console.cloud.google.com/apis/library/pubsub.googleapis.com) (take care to select the good one)\n- A [Service Account](https://console.cloud.google.com/iam-admin/serviceaccounts) for which one you need a credential JSON file (`creds.json` in example below), with roles:\n - Pub/Sub Admin\n- A local environment with Python >= 3.9\n\n### Installation\n\n```python\npip install flask-gcp-pubsub\n```\n\n### Full example\n\n`demo.py`\n```python\n#!/usr/bin/env python\n# coding: utf-8\n\nfrom flask import Flask, make_response\nfrom flask_gcp_pubsub import PubSub\n\napp = Flask(__name__)\npubsub = PubSub(\n app,\n project_id=\'\',\n gcp_credentials_file=\'./creds.json\'\n)\n\n@pubsub.task\ndef my_task(msg1, msg2):\n """Awesome delayed execution"""\n print(\'test\', msg1, msg2)\n return \'ok\'\n\n@app.route(\'/test\')\ndef route_test():\n """Launch delayed execution"""\n my_task.delay(\'test1\', \'test2\')\n return make_response(\'ok\', 200)\n```\n\n**WARNING**: do not forget to replace `` with you GCP project ID (not number) and to downloed the JSON-formatted key from GCP Console.\n\n`wsgi.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import app\n\n# Start\nif __name__ == \'__main__\':\n app.run()\n```\n\n`wsgi_delayed.py`\n```python\n#!/usr/bin/env python\n# -*- coding: utf-8 -*-\n\n# Imports\nfrom demo import pubsub\n\n# Start\nif __name__ == \'__main__\':\n pubsub.run()\n```\n\nThis command will launch the Flask server:\n```shell\nflask run --port 9090\n```\n\nThis command will launch the asynchronous tasks manager:\n```shell\npython wsgi_delayed.py\n```\n\nYou can now navigate to http://localhost:9090/test\nAnd if everything goes OK, you just have to check the content of the output in console, which should look something like that:\n```\nStart consumers\nstatus=received message_id=6860318059876990 function=my_task\ntest test1 test2\nstatus=processed message_id=6860318059876990 function=my_task result=ok execution_time=6.818771362304688e-05\n```\n\n### Bucket notification\n\nYou can also create a task based on GCP Storage, by receiving a notification on any supported event from a bucket.\n\n```python\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_FINALIZE\'])\ndef my_bucket_notifications_create(*args, **kwargs):\n print(\'FINALIZE\', args, kwargs)\n\n\n@pubsub.bucket(\'bucket-flask-gcp\', events=[\'OBJECT_DELETE\'])\ndef my_bucket_notifications_delete(*args, **kwargs):\n print(\'DELETE\', args, kwargs)\n```\n\nFor the specific Storage product, Google create a specific Service Account for specific actions, that you cannot choose. [You can found it here.](https://console.cloud.google.com/storage/settings;tab=project_access)\n\nYou have to add the **Pub/Sub Admin** role for that particular Service Account in [IAM](https://console.cloud.google.com/iam-admin/iam).\n\nThe *kwargs* returns [all attributes of the Pub/Sub notification](https://cloud.google.com/storage/docs/pubsub-notifications#attributes).\n\nIf you change the function name, the auto-clean included at start-up cannot works. As you cannot excess 10 events per bucket, do not forget to clean previous subscription with commands:\n\n```shell\ngcloud storage buckets notifications list gs://\ngcloud storage buckets notifications delete gs://\n```\n\n### Configuration\n\nConfiguration can be done using keyword arguments in class instantiation and/or flask environment variable (set with `config.update`).\nIf both method used for one configuration key, the class instanciation is primary.\n\n| Flask env variable | Keyword argument | Usage | How-to get? |\n|-|-|-|-|\n| `PUBSUB_PROJECT_ID` | `project_id` | GCP project ID | See [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_JSON` | `gcp_credentials_json` | Service account credentials, as JSON string format | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CREDENTIALS_FILE` | `gcp_credentials_file` | Servicce account credentials, as JSON local file | See IAM in [console.cloud.google.com](https://console.cloud.google.com/) |\n| `PUBSUB_CONCURRENT_CONSUMERS` | `concurrent_consumers` | Number of simultaneous consumer (default: `4`) | |\n| `PUBSUB_CONCURRENT_MESSAGES` | `concurrent_messages` | Number of messages pull from topic per consumer per call (default: `2`) | |\n| `PUBSUB_TOPIC_PREFIX` | `topic_prefix` | Prefix for all topic used in the instance, useful for feature branches using same project. | |\n\n\n## 🔮 Roadmap\n\n- [ ] Priority in the treatment of messages per functions\n- [ ] Logging instead of print (+ option to format as JSON)\n- [ ] Contributing manual\n- [ ] Documentation about Flask configuration keys and their counterpart on PubSub direct call\n\n### TO BE CONFIRMED\n\n- [ ] Region selection (default: all regions) - can be edited in Storage Rules of Topic for the moment\n'` 2023-02-21T18:57:27,035 According to the spec (see the link below), however, setuptools CANNOT 2023-02-21T18:57:27,035 consider this value unless 'readme' is listed as `dynamic`. 2023-02-21T18:57:27,036 https://packaging.python.org/en/latest/specifications/declaring-project-metadata/ 2023-02-21T18:57:27,036 For the time being, `setuptools` will still consider the given value (as a 2023-02-21T18:57:27,036 **transitional** measure), but please note that future releases of setuptools will 2023-02-21T18:57:27,036 follow strictly the standard. 2023-02-21T18:57:27,036 To prevent this warning, you can list 'readme' under `dynamic` or alternatively 2023-02-21T18:57:27,036 remove the `[project]` table from your file and rely entirely on other means of 2023-02-21T18:57:27,037 configuration. 2023-02-21T18:57:27,037 !! 2023-02-21T18:57:27,037 warnings.warn(msg, _WouldIgnoreField) 2023-02-21T18:57:27,301 running bdist_wheel 2023-02-21T18:57:27,315 running build 2023-02-21T18:57:27,315 running build_py 2023-02-21T18:57:27,320 creating build 2023-02-21T18:57:27,320 creating build/lib 2023-02-21T18:57:27,321 creating build/lib/flask_gcp_pubsub 2023-02-21T18:57:27,322 copying src/flask_gcp_pubsub/pubsub.py -> build/lib/flask_gcp_pubsub 2023-02-21T18:57:27,325 copying src/flask_gcp_pubsub/storage.py -> build/lib/flask_gcp_pubsub 2023-02-21T18:57:27,327 copying src/flask_gcp_pubsub/publisher.py -> build/lib/flask_gcp_pubsub 2023-02-21T18:57:27,328 copying src/flask_gcp_pubsub/__init__.py -> build/lib/flask_gcp_pubsub 2023-02-21T18:57:27,330 running egg_info 2023-02-21T18:57:27,338 writing src/flask_gcp_pubsub.egg-info/PKG-INFO 2023-02-21T18:57:27,340 writing dependency_links to src/flask_gcp_pubsub.egg-info/dependency_links.txt 2023-02-21T18:57:27,342 writing requirements to src/flask_gcp_pubsub.egg-info/requires.txt 2023-02-21T18:57:27,343 writing top-level names to src/flask_gcp_pubsub.egg-info/top_level.txt 2023-02-21T18:57:27,350 reading manifest file 'src/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-21T18:57:27,352 adding license file 'LICENSE' 2023-02-21T18:57:27,354 writing manifest file 'src/flask_gcp_pubsub.egg-info/SOURCES.txt' 2023-02-21T18:57:27,363 installing to build/bdist.linux-armv7l/wheel 2023-02-21T18:57:27,363 running install 2023-02-21T18:57:27,389 running install_lib 2023-02-21T18:57:27,393 creating build/bdist.linux-armv7l 2023-02-21T18:57:27,394 creating build/bdist.linux-armv7l/wheel 2023-02-21T18:57:27,396 creating build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-21T18:57:27,397 copying build/lib/flask_gcp_pubsub/pubsub.py -> build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-21T18:57:27,400 copying build/lib/flask_gcp_pubsub/storage.py -> build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-21T18:57:27,401 copying build/lib/flask_gcp_pubsub/publisher.py -> build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-21T18:57:27,403 copying build/lib/flask_gcp_pubsub/__init__.py -> build/bdist.linux-armv7l/wheel/flask_gcp_pubsub 2023-02-21T18:57:27,405 running install_egg_info 2023-02-21T18:57:27,409 Copying src/flask_gcp_pubsub.egg-info to build/bdist.linux-armv7l/wheel/flask_gcp_pubsub-0.2.1-py3.9.egg-info 2023-02-21T18:57:27,419 running install_scripts 2023-02-21T18:57:27,436 creating build/bdist.linux-armv7l/wheel/flask_gcp_pubsub-0.2.1.dist-info/WHEEL 2023-02-21T18:57:27,439 creating '/tmp/pip-wheel-r7n67ufn/.tmp-mede6yml/flask_gcp_pubsub-0.2.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-02-21T18:57:27,441 adding 'flask_gcp_pubsub/__init__.py' 2023-02-21T18:57:27,442 adding 'flask_gcp_pubsub/publisher.py' 2023-02-21T18:57:27,444 adding 'flask_gcp_pubsub/pubsub.py' 2023-02-21T18:57:27,445 adding 'flask_gcp_pubsub/storage.py' 2023-02-21T18:57:27,453 adding 'flask_gcp_pubsub-0.2.1.dist-info/LICENSE' 2023-02-21T18:57:27,455 adding 'flask_gcp_pubsub-0.2.1.dist-info/METADATA' 2023-02-21T18:57:27,456 adding 'flask_gcp_pubsub-0.2.1.dist-info/WHEEL' 2023-02-21T18:57:27,457 adding 'flask_gcp_pubsub-0.2.1.dist-info/top_level.txt' 2023-02-21T18:57:27,458 adding 'flask_gcp_pubsub-0.2.1.dist-info/RECORD' 2023-02-21T18:57:27,459 removing build/bdist.linux-armv7l/wheel 2023-02-21T18:57:27,564 Building wheel for flask-gcp-pubsub (pyproject.toml): finished with status 'done' 2023-02-21T18:57:27,571 Created wheel for flask-gcp-pubsub: filename=flask_gcp_pubsub-0.2.1-py3-none-any.whl size=20074 sha256=8aeaf5e808c46f4266f3e28b374c2d017144564e71e536f60221a7a3ea094703 2023-02-21T18:57:27,572 Stored in directory: /tmp/pip-ephem-wheel-cache-0va7i_5u/wheels/d4/cc/4c/93dc2a41ce5cc64ae31fac2527891ab35845b46cf880b7d501 2023-02-21T18:57:27,585 Successfully built flask-gcp-pubsub 2023-02-21T18:57:27,589 Removed build tracker: '/tmp/pip-build-tracker-e71c_ay4'