2023-03-07T18:32:12,936 Created temporary directory: /tmp/pip-ephem-wheel-cache-jkk23ksu 2023-03-07T18:32:12,941 Created temporary directory: /tmp/pip-build-tracker-pxy3sbu1 2023-03-07T18:32:12,942 Initialized build tracking at /tmp/pip-build-tracker-pxy3sbu1 2023-03-07T18:32:12,943 Created build tracker: /tmp/pip-build-tracker-pxy3sbu1 2023-03-07T18:32:12,943 Entered build tracker: /tmp/pip-build-tracker-pxy3sbu1 2023-03-07T18:32:12,944 Created temporary directory: /tmp/pip-wheel-ol94qwqe 2023-03-07T18:32:12,954 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-03-07T18:32:12,960 Created temporary directory: /tmp/pip-ephem-wheel-cache-t6h5_4r9 2023-03-07T18:32:13,012 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-03-07T18:32:13,020 2 location(s) to search for versions of deepspeed: 2023-03-07T18:32:13,020 * https://pypi.org/simple/deepspeed/ 2023-03-07T18:32:13,020 * https://www.piwheels.org/simple/deepspeed/ 2023-03-07T18:32:13,021 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-03-07T18:32:13,022 Getting page https://pypi.org/simple/deepspeed/ 2023-03-07T18:32:13,026 Found index url https://pypi.org/simple 2023-03-07T18:32:13,209 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-03-07T18:32:13,246 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-07T18:32:13,246 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-03-07T18:32:13,247 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-07T18:32:13,248 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-03-07T18:32:13,249 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-07T18:32:13,249 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-03-07T18:32:13,250 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-07T18:32:13,250 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-03-07T18:32:13,251 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-07T18:32:13,252 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-03-07T18:32:13,252 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-03-07T18:32:13,253 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-03-07T18:32:13,254 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-03-07T18:32:13,255 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-03-07T18:32:13,255 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-03-07T18:32:13,256 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-03-07T18:32:13,257 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-03-07T18:32:13,257 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-03-07T18:32:13,258 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-03-07T18:32:13,259 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-03-07T18:32:13,259 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-03-07T18:32:13,260 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-03-07T18:32:13,261 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-03-07T18:32:13,261 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-03-07T18:32:13,262 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-03-07T18:32:13,263 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-03-07T18:32:13,263 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-03-07T18:32:13,264 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-03-07T18:32:13,265 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-03-07T18:32:13,265 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-03-07T18:32:13,266 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-03-07T18:32:13,267 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-03-07T18:32:13,267 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-03-07T18:32:13,268 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-03-07T18:32:13,269 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-03-07T18:32:13,270 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-03-07T18:32:13,270 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-03-07T18:32:13,271 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-03-07T18:32:13,272 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-03-07T18:32:13,272 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-03-07T18:32:13,273 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-03-07T18:32:13,274 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-03-07T18:32:13,274 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-03-07T18:32:13,275 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-03-07T18:32:13,276 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-03-07T18:32:13,276 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-03-07T18:32:13,277 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-03-07T18:32:13,278 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-03-07T18:32:13,278 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-03-07T18:32:13,279 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-03-07T18:32:13,280 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-03-07T18:32:13,280 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-03-07T18:32:13,281 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-03-07T18:32:13,282 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-03-07T18:32:13,282 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-03-07T18:32:13,283 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-03-07T18:32:13,284 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-03-07T18:32:13,284 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-03-07T18:32:13,285 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-03-07T18:32:13,286 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-03-07T18:32:13,286 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-03-07T18:32:13,287 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-03-07T18:32:13,287 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-03-07T18:32:13,288 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-03-07T18:32:13,289 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-03-07T18:32:13,290 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-03-07T18:32:13,292 Found index url https://www.piwheels.org/simple 2023-03-07T18:32:13,538 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-03-07T18:32:13,564 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,565 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,566 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,566 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,567 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,567 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,568 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,568 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,569 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,569 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,570 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,571 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,571 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,572 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,572 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,573 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,573 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,574 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,574 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,575 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,575 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,576 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,576 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,577 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,577 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,578 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,578 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,579 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,579 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,580 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,580 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,581 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,581 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,582 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-03-07T18:32:13,582 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-03-07T18:32:13,583 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-03-07T18:32:13,633 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-03-07T18:32:13,662 Collecting deepspeed==0.8.2 2023-03-07T18:32:13,666 Created temporary directory: /tmp/pip-unpack-usjb_03b 2023-03-07T18:32:14,345 Downloading deepspeed-0.8.2.tar.gz (763 kB) 2023-03-07T18:32:17,170 Added deepspeed==0.8.2 from https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz to build tracker '/tmp/pip-build-tracker-pxy3sbu1' 2023-03-07T18:32:17,173 Running setup.py (path:/tmp/pip-wheel-ol94qwqe/deepspeed_fa57f403cb5b45d6bdc204256e5158ed/setup.py) egg_info for package deepspeed 2023-03-07T18:32:17,174 Created temporary directory: /tmp/pip-pip-egg-info-z85o2mpl 2023-03-07T18:32:17,175 Preparing metadata (setup.py): started 2023-03-07T18:32:17,177 Running command python setup.py egg_info 2023-03-07T18:32:19,319 fatal: not a git repository (or any of the parent directories): .git 2023-03-07T18:32:19,911 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-03-07T18:32:19,912  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-03-07T18:32:19,912 DS_BUILD_OPS=0 2023-03-07T18:32:19,912  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-03-07T18:32:19,913  [WARNING]  async_io: please install the libaio-dev package with apt 2023-03-07T18:32:19,913  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-03-07T18:32:19,913  [WARNING]  unable to import torch, please install it first 2023-03-07T18:32:19,914  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-03-07T18:32:19,914  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-03-07T18:32:19,915 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-03-07T18:32:19,915 version=0.8.2, git_hash=unknown, git_branch=unknown 2023-03-07T18:32:19,915 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-03-07T18:32:19,916 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-03-07T18:32:19,916 ext_modules=[] 2023-03-07T18:32:19,916 running egg_info 2023-03-07T18:32:19,917 creating /tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info 2023-03-07T18:32:19,965 writing /tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info/PKG-INFO 2023-03-07T18:32:19,971 writing dependency_links to /tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info/dependency_links.txt 2023-03-07T18:32:19,976 writing entry points to /tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info/entry_points.txt 2023-03-07T18:32:19,980 writing requirements to /tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info/requires.txt 2023-03-07T18:32:19,982 writing top-level names to /tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info/top_level.txt 2023-03-07T18:32:19,997 writing manifest file '/tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info/SOURCES.txt' 2023-03-07T18:32:20,321 reading manifest file '/tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info/SOURCES.txt' 2023-03-07T18:32:20,324 reading manifest template 'MANIFEST.in' 2023-03-07T18:32:21,597 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-03-07T18:32:22,546 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-03-07T18:32:23,149 warning: no files found matching '*.tr' under directory 'csrc' 2023-03-07T18:32:23,294 warning: no files found matching '*.cc' under directory 'csrc' 2023-03-07T18:32:23,342 adding license file 'LICENSE' 2023-03-07T18:32:23,400 writing manifest file '/tmp/pip-pip-egg-info-z85o2mpl/deepspeed.egg-info/SOURCES.txt' 2023-03-07T18:32:23,404 deepspeed build time = 4.074905157089233 secs 2023-03-07T18:32:23,532 Preparing metadata (setup.py): finished with status 'done' 2023-03-07T18:32:23,551 Source in /tmp/pip-wheel-ol94qwqe/deepspeed_fa57f403cb5b45d6bdc204256e5158ed has version 0.8.2, which satisfies requirement deepspeed==0.8.2 from https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz 2023-03-07T18:32:23,553 Removed deepspeed==0.8.2 from https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz from build tracker '/tmp/pip-build-tracker-pxy3sbu1' 2023-03-07T18:32:23,570 Created temporary directory: /tmp/pip-unpack-jab2zdat 2023-03-07T18:32:23,571 Building wheels for collected packages: deepspeed 2023-03-07T18:32:23,580 Created temporary directory: /tmp/pip-wheel-g92st25m 2023-03-07T18:32:23,581 Building wheel for deepspeed (setup.py): started 2023-03-07T18:32:23,583 Destination directory: /tmp/pip-wheel-g92st25m 2023-03-07T18:32:23,583 Running command python setup.py bdist_wheel 2023-03-07T18:32:24,670 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-03-07T18:32:24,696  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-03-07T18:32:24,775 DS_BUILD_OPS=0 2023-03-07T18:32:25,072  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-03-07T18:32:25,235  [WARNING]  async_io: please install the libaio-dev package with apt 2023-03-07T18:32:25,236  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-03-07T18:32:25,239  [WARNING]  unable to import torch, please install it first 2023-03-07T18:32:25,240  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-03-07T18:32:25,241  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-03-07T18:32:25,242 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-03-07T18:32:25,281 fatal: not a git repository (or any of the parent directories): .git 2023-03-07T18:32:25,286 version=0.8.2, git_hash=unknown, git_branch=unknown 2023-03-07T18:32:25,288 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-03-07T18:32:25,288 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-03-07T18:32:25,289 ext_modules=[] 2023-03-07T18:32:26,338 running bdist_wheel 2023-03-07T18:32:26,493 running build 2023-03-07T18:32:26,494 running build_py 2023-03-07T18:32:26,551 creating build 2023-03-07T18:32:26,552 creating build/lib 2023-03-07T18:32:26,554 creating build/lib/deepspeed 2023-03-07T18:32:26,556 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-03-07T18:32:26,559 copying deepspeed/constants.py -> build/lib/deepspeed 2023-03-07T18:32:26,562 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-03-07T18:32:26,566 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-03-07T18:32:26,570 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-03-07T18:32:26,574 creating build/lib/deepspeed/inference 2023-03-07T18:32:26,576 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-03-07T18:32:26,580 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-03-07T18:32:26,585 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-03-07T18:32:26,590 creating build/lib/deepspeed/model_implementations 2023-03-07T18:32:26,592 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-03-07T18:32:26,599 creating build/lib/deepspeed/utils 2023-03-07T18:32:26,602 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,607 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,612 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,617 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,621 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,627 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,632 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,635 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,639 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,642 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,646 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,650 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,654 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-03-07T18:32:26,659 creating build/lib/deepspeed/nebula 2023-03-07T18:32:26,661 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-03-07T18:32:26,665 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-03-07T18:32:26,668 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-03-07T18:32:26,673 creating build/lib/deepspeed/profiling 2023-03-07T18:32:26,675 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-03-07T18:32:26,679 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-03-07T18:32:26,682 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-03-07T18:32:26,686 creating build/lib/deepspeed/accelerator 2023-03-07T18:32:26,689 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-03-07T18:32:26,693 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-03-07T18:32:26,696 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-03-07T18:32:26,701 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-03-07T18:32:26,707 creating build/lib/deepspeed/runtime 2023-03-07T18:32:26,709 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,715 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,719 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,723 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,735 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,739 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,744 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,748 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,753 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,758 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,764 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,768 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,772 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,778 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,782 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-03-07T18:32:26,788 creating build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,789 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,793 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,797 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,802 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,806 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,810 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,813 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,817 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,821 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-03-07T18:32:26,825 creating build/lib/deepspeed/pipe 2023-03-07T18:32:26,827 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-03-07T18:32:26,832 creating build/lib/deepspeed/autotuning 2023-03-07T18:32:26,833 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-03-07T18:32:26,838 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-03-07T18:32:26,842 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-03-07T18:32:26,846 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-03-07T18:32:26,849 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-03-07T18:32:26,856 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-03-07T18:32:26,862 creating build/lib/deepspeed/compression 2023-03-07T18:32:26,863 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-03-07T18:32:26,869 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-03-07T18:32:26,873 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-03-07T18:32:26,879 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-03-07T18:32:26,882 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-03-07T18:32:26,886 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-03-07T18:32:26,890 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-03-07T18:32:26,893 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-03-07T18:32:26,899 creating build/lib/deepspeed/elasticity 2023-03-07T18:32:26,901 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-03-07T18:32:26,905 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-03-07T18:32:26,909 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-03-07T18:32:26,912 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-03-07T18:32:26,916 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-03-07T18:32:26,921 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-03-07T18:32:26,926 creating build/lib/deepspeed/monitor 2023-03-07T18:32:26,927 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-03-07T18:32:26,931 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-03-07T18:32:26,934 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-03-07T18:32:26,937 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-03-07T18:32:26,941 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-03-07T18:32:26,944 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-03-07T18:32:26,947 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-03-07T18:32:26,952 creating build/lib/deepspeed/moe 2023-03-07T18:32:26,953 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-03-07T18:32:26,958 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-03-07T18:32:26,963 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-03-07T18:32:26,967 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-03-07T18:32:26,970 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-03-07T18:32:26,973 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-03-07T18:32:26,978 creating build/lib/deepspeed/ops 2023-03-07T18:32:26,979 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-03-07T18:32:26,985 creating build/lib/deepspeed/comm 2023-03-07T18:32:26,986 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-03-07T18:32:26,990 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-03-07T18:32:26,994 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-03-07T18:32:26,997 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-03-07T18:32:27,002 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-03-07T18:32:27,006 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-03-07T18:32:27,009 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-03-07T18:32:27,015 creating build/lib/deepspeed/module_inject 2023-03-07T18:32:27,016 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,023 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,026 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,030 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,034 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,038 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,042 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,045 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,050 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,053 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-03-07T18:32:27,059 creating build/lib/deepspeed/launcher 2023-03-07T18:32:27,061 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-03-07T18:32:27,066 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-03-07T18:32:27,071 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-03-07T18:32:27,076 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-03-07T18:32:27,080 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-03-07T18:32:27,087 creating build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,088 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,092 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,095 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,098 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,102 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,106 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,109 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,112 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,116 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-07T18:32:27,120 creating build/lib/deepspeed/model_implementations/diffusers 2023-03-07T18:32:27,122 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-03-07T18:32:27,126 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-03-07T18:32:27,129 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-03-07T18:32:27,134 creating build/lib/deepspeed/model_implementations/features 2023-03-07T18:32:27,136 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-03-07T18:32:27,140 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-03-07T18:32:27,144 creating build/lib/deepspeed/profiling/flops_profiler 2023-03-07T18:32:27,146 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-03-07T18:32:27,154 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-03-07T18:32:27,160 creating build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,162 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,168 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,173 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,176 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,180 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,185 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,189 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,193 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,199 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-07T18:32:27,206 creating build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,208 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,213 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,216 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,221 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,231 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,237 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,241 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,245 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,249 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,257 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,261 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,265 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,268 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-03-07T18:32:27,280 creating build/lib/deepspeed/runtime/fp16 2023-03-07T18:32:27,282 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-03-07T18:32:27,287 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-03-07T18:32:27,292 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-03-07T18:32:27,297 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-03-07T18:32:27,303 creating build/lib/deepspeed/runtime/pipe 2023-03-07T18:32:27,305 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-03-07T18:32:27,313 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-03-07T18:32:27,317 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-03-07T18:32:27,322 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-03-07T18:32:27,327 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-03-07T18:32:27,331 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-03-07T18:32:27,337 creating build/lib/deepspeed/runtime/compression 2023-03-07T18:32:27,338 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-03-07T18:32:27,342 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-03-07T18:32:27,347 creating build/lib/deepspeed/runtime/data_pipeline 2023-03-07T18:32:27,349 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-03-07T18:32:27,353 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-03-07T18:32:27,357 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-03-07T18:32:27,362 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-03-07T18:32:27,366 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-03-07T18:32:27,368 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-03-07T18:32:27,372 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-03-07T18:32:27,375 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-03-07T18:32:27,383 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:27,385 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:27,389 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:27,392 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:27,396 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:27,401 creating build/lib/deepspeed/runtime/comm 2023-03-07T18:32:27,403 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-03-07T18:32:27,407 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-03-07T18:32:27,412 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-03-07T18:32:27,415 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-03-07T18:32:27,421 creating build/lib/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:27,423 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:27,428 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:27,433 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:27,437 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:27,443 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:27,445 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:27,450 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:27,453 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:27,456 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:27,473 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:27,478 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:27,480 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:27,486 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:27,491 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:27,494 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:27,498 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:27,504 creating build/lib/deepspeed/autotuning/tuner 2023-03-07T18:32:27,506 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-03-07T18:32:27,510 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-03-07T18:32:27,513 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-03-07T18:32:27,517 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-03-07T18:32:27,521 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-03-07T18:32:27,524 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-03-07T18:32:27,529 creating build/lib/deepspeed/ops/adam 2023-03-07T18:32:27,530 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-03-07T18:32:27,534 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-03-07T18:32:27,537 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-03-07T18:32:27,541 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-03-07T18:32:27,547 creating build/lib/deepspeed/ops/lamb 2023-03-07T18:32:27,549 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-03-07T18:32:27,554 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-03-07T18:32:27,558 creating build/lib/deepspeed/ops/transformer 2023-03-07T18:32:27,560 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-03-07T18:32:27,564 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-03-07T18:32:27,570 creating build/lib/deepspeed/ops/random_ltd 2023-03-07T18:32:27,572 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-03-07T18:32:27,576 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-03-07T18:32:27,581 creating build/lib/deepspeed/ops/adagrad 2023-03-07T18:32:27,583 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-03-07T18:32:27,587 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-03-07T18:32:27,592 creating build/lib/deepspeed/ops/sparse_attention 2023-03-07T18:32:27,594 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-07T18:32:27,599 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-07T18:32:27,602 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-07T18:32:27,609 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-07T18:32:27,614 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-07T18:32:27,619 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-07T18:32:27,622 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-07T18:32:27,632 creating build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,634 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,638 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,642 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,646 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,650 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,653 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,657 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,661 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,664 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,669 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,672 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,676 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,679 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,686 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,689 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,693 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-03-07T18:32:27,698 creating build/lib/deepspeed/ops/quantizer 2023-03-07T18:32:27,700 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-03-07T18:32:27,704 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-03-07T18:32:27,708 creating build/lib/deepspeed/ops/aio 2023-03-07T18:32:27,710 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-03-07T18:32:27,716 creating build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,718 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,723 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,728 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,734 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,738 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,743 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,746 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,750 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,754 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,758 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-07T18:32:27,765 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,767 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,771 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,775 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,778 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,782 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,786 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,790 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,793 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,797 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,801 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:27,806 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:27,807 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:27,814 creating build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,815 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,819 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,823 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,827 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,831 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,834 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,838 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,842 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,846 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,850 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,854 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,858 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,861 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,865 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,870 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,874 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-03-07T18:32:27,879 creating build/lib/deepspeed/module_inject/containers/features 2023-03-07T18:32:27,880 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-03-07T18:32:27,884 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-03-07T18:32:27,887 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-03-07T18:32:27,892 running egg_info 2023-03-07T18:32:27,998 writing deepspeed.egg-info/PKG-INFO 2023-03-07T18:32:28,004 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-03-07T18:32:28,008 writing entry points to deepspeed.egg-info/entry_points.txt 2023-03-07T18:32:28,012 writing requirements to deepspeed.egg-info/requires.txt 2023-03-07T18:32:28,015 writing top-level names to deepspeed.egg-info/top_level.txt 2023-03-07T18:32:28,156 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-03-07T18:32:28,192 reading manifest template 'MANIFEST.in' 2023-03-07T18:32:29,555 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-03-07T18:32:30,527 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-03-07T18:32:31,156 warning: no files found matching '*.tr' under directory 'csrc' 2023-03-07T18:32:31,309 warning: no files found matching '*.cc' under directory 'csrc' 2023-03-07T18:32:31,356 adding license file 'LICENSE' 2023-03-07T18:32:31,426 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-03-07T18:32:31,443 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.autotuning.config_templates' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,443 !! 2023-03-07T18:32:31,444 ############################ 2023-03-07T18:32:31,445 # Package would be ignored # 2023-03-07T18:32:31,445 ############################ 2023-03-07T18:32:31,445 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, 2023-03-07T18:32:31,446 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,446 'deepspeed.autotuning.config_templates' has been automatically added to the distribution only 2023-03-07T18:32:31,446 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,447 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,447 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2023-03-07T18:32:31,448 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,448 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,448 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,449 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,449 documentation page. 2023-03-07T18:32:31,450 !! 2023-03-07T18:32:31,451 check.warn(importable) 2023-03-07T18:32:31,451 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adagrad' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,451 !! 2023-03-07T18:32:31,452 ############################ 2023-03-07T18:32:31,453 # Package would be ignored # 2023-03-07T18:32:31,453 ############################ 2023-03-07T18:32:31,453 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, 2023-03-07T18:32:31,453 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,454 'deepspeed.ops.csrc.adagrad' has been automatically added to the distribution only 2023-03-07T18:32:31,454 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,455 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,455 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2023-03-07T18:32:31,456 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,456 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,456 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,457 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,457 documentation page. 2023-03-07T18:32:31,458 !! 2023-03-07T18:32:31,459 check.warn(importable) 2023-03-07T18:32:31,459 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adam' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,459 !! 2023-03-07T18:32:31,460 ############################ 2023-03-07T18:32:31,461 # Package would be ignored # 2023-03-07T18:32:31,461 ############################ 2023-03-07T18:32:31,461 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, 2023-03-07T18:32:31,461 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,462 'deepspeed.ops.csrc.adam' has been automatically added to the distribution only 2023-03-07T18:32:31,462 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,463 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,463 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2023-03-07T18:32:31,463 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,464 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,464 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,465 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,465 documentation page. 2023-03-07T18:32:31,466 !! 2023-03-07T18:32:31,466 check.warn(importable) 2023-03-07T18:32:31,467 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.common' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,467 !! 2023-03-07T18:32:31,468 ############################ 2023-03-07T18:32:31,468 # Package would be ignored # 2023-03-07T18:32:31,469 ############################ 2023-03-07T18:32:31,469 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, 2023-03-07T18:32:31,469 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,470 'deepspeed.ops.csrc.aio.common' has been automatically added to the distribution only 2023-03-07T18:32:31,470 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,470 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,471 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2023-03-07T18:32:31,471 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,472 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,472 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,472 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,473 documentation page. 2023-03-07T18:32:31,474 !! 2023-03-07T18:32:31,474 check.warn(importable) 2023-03-07T18:32:31,474 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_lib' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,475 !! 2023-03-07T18:32:31,476 ############################ 2023-03-07T18:32:31,476 # Package would be ignored # 2023-03-07T18:32:31,476 ############################ 2023-03-07T18:32:31,476 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, 2023-03-07T18:32:31,477 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,477 'deepspeed.ops.csrc.aio.py_lib' has been automatically added to the distribution only 2023-03-07T18:32:31,478 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,478 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,479 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2023-03-07T18:32:31,479 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,479 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,479 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,480 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,480 documentation page. 2023-03-07T18:32:31,481 !! 2023-03-07T18:32:31,482 check.warn(importable) 2023-03-07T18:32:31,482 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_test' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,482 !! 2023-03-07T18:32:31,483 ############################ 2023-03-07T18:32:31,483 # Package would be ignored # 2023-03-07T18:32:31,484 ############################ 2023-03-07T18:32:31,484 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, 2023-03-07T18:32:31,484 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,485 'deepspeed.ops.csrc.aio.py_test' has been automatically added to the distribution only 2023-03-07T18:32:31,485 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,485 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,486 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2023-03-07T18:32:31,486 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,487 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,487 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,487 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,488 documentation page. 2023-03-07T18:32:31,489 !! 2023-03-07T18:32:31,489 check.warn(importable) 2023-03-07T18:32:31,490 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.common' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,490 !! 2023-03-07T18:32:31,491 ############################ 2023-03-07T18:32:31,491 # Package would be ignored # 2023-03-07T18:32:31,491 ############################ 2023-03-07T18:32:31,492 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, 2023-03-07T18:32:31,492 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,492 'deepspeed.ops.csrc.common' has been automatically added to the distribution only 2023-03-07T18:32:31,493 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,493 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,494 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2023-03-07T18:32:31,494 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,494 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,494 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,495 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,495 documentation page. 2023-03-07T18:32:31,496 !! 2023-03-07T18:32:31,497 check.warn(importable) 2023-03-07T18:32:31,497 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.includes' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,497 !! 2023-03-07T18:32:31,498 ############################ 2023-03-07T18:32:31,499 # Package would be ignored # 2023-03-07T18:32:31,499 ############################ 2023-03-07T18:32:31,499 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, 2023-03-07T18:32:31,500 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,500 'deepspeed.ops.csrc.includes' has been automatically added to the distribution only 2023-03-07T18:32:31,500 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,501 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,501 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2023-03-07T18:32:31,502 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,502 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,502 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,503 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,503 documentation page. 2023-03-07T18:32:31,504 !! 2023-03-07T18:32:31,504 check.warn(importable) 2023-03-07T18:32:31,505 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.lamb' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,505 !! 2023-03-07T18:32:31,506 ############################ 2023-03-07T18:32:31,506 # Package would be ignored # 2023-03-07T18:32:31,506 ############################ 2023-03-07T18:32:31,507 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, 2023-03-07T18:32:31,507 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,508 'deepspeed.ops.csrc.lamb' has been automatically added to the distribution only 2023-03-07T18:32:31,508 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,508 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,509 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2023-03-07T18:32:31,509 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,510 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,510 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,510 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,511 documentation page. 2023-03-07T18:32:31,512 !! 2023-03-07T18:32:31,512 check.warn(importable) 2023-03-07T18:32:31,513 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.quantization' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,513 !! 2023-03-07T18:32:31,514 ############################ 2023-03-07T18:32:31,514 # Package would be ignored # 2023-03-07T18:32:31,515 ############################ 2023-03-07T18:32:31,515 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, 2023-03-07T18:32:31,515 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,516 'deepspeed.ops.csrc.quantization' has been automatically added to the distribution only 2023-03-07T18:32:31,516 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,516 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,517 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2023-03-07T18:32:31,517 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,518 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,518 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,519 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,519 documentation page. 2023-03-07T18:32:31,520 !! 2023-03-07T18:32:31,521 check.warn(importable) 2023-03-07T18:32:31,521 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.random_ltd' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,521 !! 2023-03-07T18:32:31,522 ############################ 2023-03-07T18:32:31,523 # Package would be ignored # 2023-03-07T18:32:31,523 ############################ 2023-03-07T18:32:31,523 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package, 2023-03-07T18:32:31,524 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,524 'deepspeed.ops.csrc.random_ltd' has been automatically added to the distribution only 2023-03-07T18:32:31,525 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,525 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,526 Please make sure that 'deepspeed.ops.csrc.random_ltd' is included as a package by using 2023-03-07T18:32:31,526 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,526 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,526 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,527 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,527 documentation page. 2023-03-07T18:32:31,528 !! 2023-03-07T18:32:31,529 check.warn(importable) 2023-03-07T18:32:31,529 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.sparse_attention' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,530 !! 2023-03-07T18:32:31,531 ############################ 2023-03-07T18:32:31,531 # Package would be ignored # 2023-03-07T18:32:31,531 ############################ 2023-03-07T18:32:31,532 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, 2023-03-07T18:32:31,532 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,532 'deepspeed.ops.csrc.sparse_attention' has been automatically added to the distribution only 2023-03-07T18:32:31,533 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,533 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,534 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2023-03-07T18:32:31,534 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,534 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,535 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,535 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,536 documentation page. 2023-03-07T18:32:31,537 !! 2023-03-07T18:32:31,537 check.warn(importable) 2023-03-07T18:32:31,538 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.csrc' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,538 !! 2023-03-07T18:32:31,539 ############################ 2023-03-07T18:32:31,539 # Package would be ignored # 2023-03-07T18:32:31,540 ############################ 2023-03-07T18:32:31,540 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package, 2023-03-07T18:32:31,540 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,541 'deepspeed.ops.csrc.spatial.csrc' has been automatically added to the distribution only 2023-03-07T18:32:31,541 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,542 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,542 Please make sure that 'deepspeed.ops.csrc.spatial.csrc' is included as a package by using 2023-03-07T18:32:31,543 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,543 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,543 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,544 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,544 documentation page. 2023-03-07T18:32:31,545 !! 2023-03-07T18:32:31,546 check.warn(importable) 2023-03-07T18:32:31,546 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.includes' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,546 !! 2023-03-07T18:32:31,547 ############################ 2023-03-07T18:32:31,548 # Package would be ignored # 2023-03-07T18:32:31,548 ############################ 2023-03-07T18:32:31,548 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package, 2023-03-07T18:32:31,549 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,549 'deepspeed.ops.csrc.spatial.includes' has been automatically added to the distribution only 2023-03-07T18:32:31,550 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,550 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,551 Please make sure that 'deepspeed.ops.csrc.spatial.includes' is included as a package by using 2023-03-07T18:32:31,551 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,551 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,552 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,552 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,553 documentation page. 2023-03-07T18:32:31,553 !! 2023-03-07T18:32:31,554 check.warn(importable) 2023-03-07T18:32:31,554 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,555 !! 2023-03-07T18:32:31,556 ############################ 2023-03-07T18:32:31,556 # Package would be ignored # 2023-03-07T18:32:31,556 ############################ 2023-03-07T18:32:31,557 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, 2023-03-07T18:32:31,557 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,557 'deepspeed.ops.csrc.transformer' has been automatically added to the distribution only 2023-03-07T18:32:31,558 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,558 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,559 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2023-03-07T18:32:31,559 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,559 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,560 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,560 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,561 documentation page. 2023-03-07T18:32:31,562 !! 2023-03-07T18:32:31,562 check.warn(importable) 2023-03-07T18:32:31,563 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.csrc' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,563 !! 2023-03-07T18:32:31,564 ############################ 2023-03-07T18:32:31,564 # Package would be ignored # 2023-03-07T18:32:31,564 ############################ 2023-03-07T18:32:31,565 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, 2023-03-07T18:32:31,565 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,566 'deepspeed.ops.csrc.transformer.inference.csrc' has been automatically added to the distribution only 2023-03-07T18:32:31,566 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,566 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,567 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2023-03-07T18:32:31,567 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,568 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,568 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,569 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,569 documentation page. 2023-03-07T18:32:31,570 !! 2023-03-07T18:32:31,570 check.warn(importable) 2023-03-07T18:32:31,571 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.includes' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,571 !! 2023-03-07T18:32:31,572 ############################ 2023-03-07T18:32:31,572 # Package would be ignored # 2023-03-07T18:32:31,573 ############################ 2023-03-07T18:32:31,573 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, 2023-03-07T18:32:31,573 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,574 'deepspeed.ops.csrc.transformer.inference.includes' has been automatically added to the distribution only 2023-03-07T18:32:31,574 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,575 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,575 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2023-03-07T18:32:31,575 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,576 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,576 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,577 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,577 documentation page. 2023-03-07T18:32:31,578 !! 2023-03-07T18:32:31,579 check.warn(importable) 2023-03-07T18:32:31,579 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.utils' as data is deprecated, please list it in `packages`. 2023-03-07T18:32:31,579 !! 2023-03-07T18:32:31,580 ############################ 2023-03-07T18:32:31,581 # Package would be ignored # 2023-03-07T18:32:31,581 ############################ 2023-03-07T18:32:31,581 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, 2023-03-07T18:32:31,582 but it is not listed in the `packages` configuration of setuptools. 2023-03-07T18:32:31,582 'deepspeed.ops.csrc.utils' has been automatically added to the distribution only 2023-03-07T18:32:31,583 because it may contain data files, but this behavior is likely to change 2023-03-07T18:32:31,583 in future versions of setuptools (and therefore is considered deprecated). 2023-03-07T18:32:31,584 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2023-03-07T18:32:31,584 the `packages` configuration field or the proper discovery methods 2023-03-07T18:32:31,584 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-07T18:32:31,584 instead of `find_packages(...)`/`find:`). 2023-03-07T18:32:31,585 You can read more about "package discovery" and "data files" on setuptools 2023-03-07T18:32:31,585 documentation page. 2023-03-07T18:32:31,586 !! 2023-03-07T18:32:31,587 check.warn(importable) 2023-03-07T18:32:31,587 creating build/lib/deepspeed/autotuning/config_templates 2023-03-07T18:32:31,588 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-03-07T18:32:31,588 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-03-07T18:32:31,588 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-03-07T18:32:31,589 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-03-07T18:32:31,589 creating build/lib/deepspeed/ops/csrc 2023-03-07T18:32:31,589 creating build/lib/deepspeed/ops/csrc/adagrad 2023-03-07T18:32:31,589 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-03-07T18:32:31,590 creating build/lib/deepspeed/ops/csrc/adam 2023-03-07T18:32:31,590 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-03-07T18:32:31,590 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-03-07T18:32:31,591 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-03-07T18:32:31,591 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-03-07T18:32:31,591 creating build/lib/deepspeed/ops/csrc/aio 2023-03-07T18:32:31,592 creating build/lib/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:31,592 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:31,592 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:31,593 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:31,593 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:31,593 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:31,594 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:31,594 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,594 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,599 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,603 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,607 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,612 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,616 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,620 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,625 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,629 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,634 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,638 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:31,642 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-03-07T18:32:31,643 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-03-07T18:32:31,647 creating build/lib/deepspeed/ops/csrc/common 2023-03-07T18:32:31,649 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-03-07T18:32:31,653 creating build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,655 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,659 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,663 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,667 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,672 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,677 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,681 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,686 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,690 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,695 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,699 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,704 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,707 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,712 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,716 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,720 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,725 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,729 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,735 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,740 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,744 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,750 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,754 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,759 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,763 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,767 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,772 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-07T18:32:31,777 creating build/lib/deepspeed/ops/csrc/lamb 2023-03-07T18:32:31,779 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-03-07T18:32:31,783 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-03-07T18:32:31,789 creating build/lib/deepspeed/ops/csrc/quantization 2023-03-07T18:32:31,790 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-03-07T18:32:31,795 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-03-07T18:32:31,801 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-03-07T18:32:31,806 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-03-07T18:32:31,811 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:31,813 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:31,819 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:31,824 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:31,829 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:31,835 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-03-07T18:32:31,837 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-03-07T18:32:31,842 creating build/lib/deepspeed/ops/csrc/spatial 2023-03-07T18:32:31,844 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-03-07T18:32:31,846 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-03-07T18:32:31,852 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-03-07T18:32:31,857 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-03-07T18:32:31,859 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-03-07T18:32:31,864 creating build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,866 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,872 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,879 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,886 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,891 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,896 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,904 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,909 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-07T18:32:31,915 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-03-07T18:32:31,916 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,918 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,924 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,928 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,934 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,939 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,948 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,952 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,957 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:31,963 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-03-07T18:32:31,965 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-03-07T18:32:31,970 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-03-07T18:32:31,976 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-03-07T18:32:31,981 creating build/lib/deepspeed/ops/csrc/utils 2023-03-07T18:32:31,983 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-03-07T18:32:31,987 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:31,992 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:31,996 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:32,073 running build_scripts 2023-03-07T18:32:32,075 creating build/scripts-3.7 2023-03-07T18:32:32,077 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-03-07T18:32:32,080 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-03-07T18:32:32,083 copying and adjusting bin/ds -> build/scripts-3.7 2023-03-07T18:32:32,087 copying bin/ds_ssh -> build/scripts-3.7 2023-03-07T18:32:32,091 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-03-07T18:32:32,094 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-03-07T18:32:32,097 copying and adjusting bin/dsr -> build/scripts-3.7 2023-03-07T18:32:32,100 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-03-07T18:32:32,102 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-03-07T18:32:32,102 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-03-07T18:32:32,103 changing mode of build/scripts-3.7/ds from 644 to 755 2023-03-07T18:32:32,104 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-03-07T18:32:32,105 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-03-07T18:32:32,105 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-03-07T18:32:32,106 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-03-07T18:32:32,166 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2023-03-07T18:32:32,166 setuptools.SetuptoolsDeprecationWarning, 2023-03-07T18:32:32,221 installing to build/bdist.linux-armv7l/wheel 2023-03-07T18:32:32,221 running install 2023-03-07T18:32:32,280 running install_lib 2023-03-07T18:32:32,336 creating build/bdist.linux-armv7l 2023-03-07T18:32:32,337 creating build/bdist.linux-armv7l/wheel 2023-03-07T18:32:32,341 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-03-07T18:32:32,344 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-03-07T18:32:32,346 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-03-07T18:32:32,351 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-03-07T18:32:32,356 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-03-07T18:32:32,361 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-03-07T18:32:32,364 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,366 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,370 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,375 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,379 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,383 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,388 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,392 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,396 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,399 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-07T18:32:32,404 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-03-07T18:32:32,406 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-03-07T18:32:32,411 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-03-07T18:32:32,415 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-03-07T18:32:32,420 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-03-07T18:32:32,422 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-03-07T18:32:32,426 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-03-07T18:32:32,430 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-03-07T18:32:32,433 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-07T18:32:32,438 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,440 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,444 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,448 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,452 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,456 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,461 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,466 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,469 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,473 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,476 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,480 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,485 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,489 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-07T18:32:32,494 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-03-07T18:32:32,495 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-03-07T18:32:32,499 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-03-07T18:32:32,503 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-03-07T18:32:32,508 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-03-07T18:32:32,510 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-03-07T18:32:32,514 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-03-07T18:32:32,516 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-03-07T18:32:32,523 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-03-07T18:32:32,526 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-03-07T18:32:32,530 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-03-07T18:32:32,534 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-07T18:32:32,536 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-07T18:32:32,540 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-07T18:32:32,554 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-07T18:32:32,559 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-07T18:32:32,565 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,566 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,572 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,577 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,579 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,584 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,589 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,592 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,596 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,600 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,604 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,608 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,613 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-07T18:32:32,619 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,621 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,625 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,629 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,634 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,646 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,651 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,656 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,660 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,664 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,672 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,676 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,680 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,684 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-07T18:32:32,698 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-07T18:32:32,701 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-07T18:32:32,707 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-07T18:32:32,711 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-07T18:32:32,717 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:32,719 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:32,724 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:32,730 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:32,733 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-07T18:32:32,738 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-07T18:32:32,743 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-07T18:32:32,745 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-07T18:32:32,753 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-07T18:32:32,759 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-07T18:32:32,764 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-07T18:32:32,769 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-07T18:32:32,773 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-07T18:32:32,777 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,781 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,793 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,798 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-03-07T18:32:32,800 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-03-07T18:32:32,804 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-03-07T18:32:32,807 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,812 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,817 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-07T18:32:32,820 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:32,822 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:32,826 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:32,830 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:32,833 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:32,837 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-07T18:32:32,841 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-07T18:32:32,846 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:32,848 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:32,854 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:32,859 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:32,862 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:32,866 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-07T18:32:32,871 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-07T18:32:32,876 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-07T18:32:32,880 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-07T18:32:32,884 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,889 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,894 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,900 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,905 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-03-07T18:32:32,907 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-03-07T18:32:32,911 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-03-07T18:32:32,914 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-03-07T18:32:32,920 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,924 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,930 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,935 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:32,937 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:32,942 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:32,946 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:32,950 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-07T18:32:32,954 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-07T18:32:32,960 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-07T18:32:32,963 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-07T18:32:32,968 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-07T18:32:32,973 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-07T18:32:32,977 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-07T18:32:32,982 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:32,984 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:32,988 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:32,992 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:32,996 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:33,001 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:33,005 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:33,008 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:33,012 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:33,016 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-07T18:32:33,020 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-03-07T18:32:33,022 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-03-07T18:32:33,027 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-07T18:32:33,029 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-07T18:32:33,035 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-07T18:32:33,036 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-07T18:32:33,040 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-07T18:32:33,043 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-07T18:32:33,047 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-07T18:32:33,051 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-07T18:32:33,055 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-07T18:32:33,060 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-07T18:32:33,064 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-07T18:32:33,071 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-07T18:32:33,073 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-07T18:32:33,077 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-07T18:32:33,081 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-07T18:32:33,085 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-07T18:32:33,088 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-07T18:32:33,092 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-07T18:32:33,096 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-07T18:32:33,101 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,103 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,108 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,113 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,119 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,123 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,127 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,130 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,134 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-07T18:32:33,139 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-07T18:32:33,143 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-07T18:32:33,145 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-07T18:32:33,149 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-07T18:32:33,153 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-07T18:32:33,156 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-07T18:32:33,160 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-07T18:32:33,165 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-07T18:32:33,170 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-07T18:32:33,172 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-07T18:32:33,176 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-07T18:32:33,180 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-07T18:32:33,184 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-07T18:32:33,188 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-07T18:32:33,192 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-07T18:32:33,196 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-07T18:32:33,200 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-07T18:32:33,205 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-07T18:32:33,210 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-07T18:32:33,213 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-07T18:32:33,217 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-07T18:32:33,223 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-07T18:32:33,227 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-07T18:32:33,230 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-07T18:32:33,234 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-07T18:32:33,239 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-03-07T18:32:33,243 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-07T18:32:33,245 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-07T18:32:33,250 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-07T18:32:33,254 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-07T18:32:33,258 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-07T18:32:33,264 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-03-07T18:32:33,267 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-03-07T18:32:33,272 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-03-07T18:32:33,277 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-03-07T18:32:33,280 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-07T18:32:33,282 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-07T18:32:33,287 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-07T18:32:33,327 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-07T18:32:33,332 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-07T18:32:33,337 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-07T18:32:33,339 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-07T18:32:33,343 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-07T18:32:33,347 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-07T18:32:33,351 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-07T18:32:33,358 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-03-07T18:32:33,360 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-03-07T18:32:33,365 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-03-07T18:32:33,366 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-03-07T18:32:33,370 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-03-07T18:32:33,376 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,379 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-03-07T18:32:33,382 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,383 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,390 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,395 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,403 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,407 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,413 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,419 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,422 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-07T18:32:33,429 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-03-07T18:32:33,430 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-03-07T18:32:33,435 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-03-07T18:32:33,440 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-03-07T18:32:33,445 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,450 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,454 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,462 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,468 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,472 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,479 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,483 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-07T18:32:33,489 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-03-07T18:32:33,491 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-03-07T18:32:33,493 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-03-07T18:32:33,497 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-03-07T18:32:33,502 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-03-07T18:32:33,503 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-03-07T18:32:33,508 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:33,510 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:33,514 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:33,518 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:33,522 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-07T18:32:33,528 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-03-07T18:32:33,530 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-03-07T18:32:33,535 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-03-07T18:32:33,536 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-03-07T18:32:33,542 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-03-07T18:32:33,544 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,546 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,550 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,554 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,557 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,560 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,564 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,568 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,571 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,575 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,579 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,583 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-07T18:32:33,587 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-03-07T18:32:33,589 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-03-07T18:32:33,594 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:33,596 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:33,601 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:33,605 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:33,608 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:33,612 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:33,615 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-07T18:32:33,620 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,622 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,626 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,630 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,635 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,640 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,643 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,647 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,651 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,655 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,659 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,662 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,666 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,671 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,674 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,680 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,684 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,687 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,692 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,695 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,699 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,702 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,707 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,710 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,715 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,719 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,722 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,726 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-07T18:32:33,732 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-03-07T18:32:33,733 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-03-07T18:32:33,738 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-03-07T18:32:33,741 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,743 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,747 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,752 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,757 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,762 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,766 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,770 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,773 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,778 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,783 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,785 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,789 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,792 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,796 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,799 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,803 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,806 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,810 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,814 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,817 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-07T18:32:33,821 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-07T18:32:33,826 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-03-07T18:32:33,829 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-03-07T18:32:33,836 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-03-07T18:32:33,838 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-03-07T18:32:33,842 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-03-07T18:32:33,847 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-03-07T18:32:33,849 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-03-07T18:32:33,853 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-03-07T18:32:33,859 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-07T18:32:33,860 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-07T18:32:33,865 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-07T18:32:33,868 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-07T18:32:33,875 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-07T18:32:33,880 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-07T18:32:33,885 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-07T18:32:33,889 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-07T18:32:33,896 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:33,899 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:33,904 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:33,908 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:33,912 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-07T18:32:33,917 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,919 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,923 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,928 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,931 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,935 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,939 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,942 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,946 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,950 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,954 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,958 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,961 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,965 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,971 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,974 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,978 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-07T18:32:33,983 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-03-07T18:32:33,984 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-03-07T18:32:33,988 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-03-07T18:32:33,993 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-03-07T18:32:33,994 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-03-07T18:32:33,998 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-03-07T18:32:34,003 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-07T18:32:34,004 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-07T18:32:34,008 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-07T18:32:34,012 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-07T18:32:34,016 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-07T18:32:34,021 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-07T18:32:34,025 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-07T18:32:34,028 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-07T18:32:34,032 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-07T18:32:34,036 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,038 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,044 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,047 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,053 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,055 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,059 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,062 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,066 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,070 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,074 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,077 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,082 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-03-07T18:32:34,083 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-03-07T18:32:34,087 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-03-07T18:32:34,091 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-03-07T18:32:34,094 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,098 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,102 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,106 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,109 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,112 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,116 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,120 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,124 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-07T18:32:34,128 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,132 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,136 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,139 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,142 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,146 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,150 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-07T18:32:34,154 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-07T18:32:34,156 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-07T18:32:34,161 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-07T18:32:34,165 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-07T18:32:34,170 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-07T18:32:34,174 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-07T18:32:34,178 running install_egg_info 2023-03-07T18:32:34,242 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.8.2-py3.7.egg-info 2023-03-07T18:32:34,269 running install_scripts 2023-03-07T18:32:34,272 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data 2023-03-07T18:32:34,273 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,275 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,279 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,282 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,286 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,290 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,293 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,296 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,300 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts 2023-03-07T18:32:34,303 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts/deepspeed.pt to 755 2023-03-07T18:32:34,304 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts/ds_ssh to 755 2023-03-07T18:32:34,305 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts/ds_elastic to 755 2023-03-07T18:32:34,305 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts/ds to 755 2023-03-07T18:32:34,306 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts/ds_report to 755 2023-03-07T18:32:34,307 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts/ds_bench to 755 2023-03-07T18:32:34,308 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts/deepspeed to 755 2023-03-07T18:32:34,308 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.data/scripts/dsr to 755 2023-03-07T18:32:34,449 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2023-03-07T18:32:34,458 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.2.dist-info/WHEEL 2023-03-07T18:32:34,463 creating '/tmp/pip-wheel-g92st25m/deepspeed-0.8.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-03-07T18:32:34,470 adding 'deepspeed/__init__.py' 2023-03-07T18:32:34,473 adding 'deepspeed/constants.py' 2023-03-07T18:32:34,477 adding 'deepspeed/env_report.py' 2023-03-07T18:32:34,479 adding 'deepspeed/git_version_info.py' 2023-03-07T18:32:34,482 adding 'deepspeed/git_version_info_installed.py' 2023-03-07T18:32:34,485 adding 'deepspeed/accelerator/__init__.py' 2023-03-07T18:32:34,488 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-03-07T18:32:34,491 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-03-07T18:32:34,494 adding 'deepspeed/accelerator/real_accelerator.py' 2023-03-07T18:32:34,498 adding 'deepspeed/autotuning/__init__.py' 2023-03-07T18:32:34,511 adding 'deepspeed/autotuning/autotuner.py' 2023-03-07T18:32:34,516 adding 'deepspeed/autotuning/config.py' 2023-03-07T18:32:34,519 adding 'deepspeed/autotuning/constants.py' 2023-03-07T18:32:34,524 adding 'deepspeed/autotuning/scheduler.py' 2023-03-07T18:32:34,530 adding 'deepspeed/autotuning/utils.py' 2023-03-07T18:32:34,534 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-03-07T18:32:34,536 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-03-07T18:32:34,539 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-03-07T18:32:34,541 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-03-07T18:32:34,545 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-03-07T18:32:34,547 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-03-07T18:32:34,550 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-03-07T18:32:34,553 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-03-07T18:32:34,556 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-03-07T18:32:34,559 adding 'deepspeed/autotuning/tuner/utils.py' 2023-03-07T18:32:34,563 adding 'deepspeed/checkpoint/__init__.py' 2023-03-07T18:32:34,565 adding 'deepspeed/checkpoint/constants.py' 2023-03-07T18:32:34,570 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-03-07T18:32:34,573 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-03-07T18:32:34,577 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-03-07T18:32:34,580 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-03-07T18:32:34,583 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-03-07T18:32:34,586 adding 'deepspeed/checkpoint/utils.py' 2023-03-07T18:32:34,589 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-03-07T18:32:34,593 adding 'deepspeed/comm/__init__.py' 2023-03-07T18:32:34,596 adding 'deepspeed/comm/backend.py' 2023-03-07T18:32:34,603 adding 'deepspeed/comm/comm.py' 2023-03-07T18:32:34,606 adding 'deepspeed/comm/config.py' 2023-03-07T18:32:34,609 adding 'deepspeed/comm/constants.py' 2023-03-07T18:32:34,613 adding 'deepspeed/comm/torch.py' 2023-03-07T18:32:34,616 adding 'deepspeed/comm/utils.py' 2023-03-07T18:32:34,620 adding 'deepspeed/compression/__init__.py' 2023-03-07T18:32:34,628 adding 'deepspeed/compression/basic_layer.py' 2023-03-07T18:32:34,633 adding 'deepspeed/compression/compress.py' 2023-03-07T18:32:34,637 adding 'deepspeed/compression/config.py' 2023-03-07T18:32:34,641 adding 'deepspeed/compression/constants.py' 2023-03-07T18:32:34,644 adding 'deepspeed/compression/helper.py' 2023-03-07T18:32:34,648 adding 'deepspeed/compression/scheduler.py' 2023-03-07T18:32:34,651 adding 'deepspeed/compression/utils.py' 2023-03-07T18:32:34,655 adding 'deepspeed/elasticity/__init__.py' 2023-03-07T18:32:34,659 adding 'deepspeed/elasticity/config.py' 2023-03-07T18:32:34,662 adding 'deepspeed/elasticity/constants.py' 2023-03-07T18:32:34,665 adding 'deepspeed/elasticity/elastic_agent.py' 2023-03-07T18:32:34,671 adding 'deepspeed/elasticity/elasticity.py' 2023-03-07T18:32:34,673 adding 'deepspeed/elasticity/utils.py' 2023-03-07T18:32:34,677 adding 'deepspeed/inference/__init__.py' 2023-03-07T18:32:34,681 adding 'deepspeed/inference/config.py' 2023-03-07T18:32:34,688 adding 'deepspeed/inference/engine.py' 2023-03-07T18:32:34,692 adding 'deepspeed/launcher/__init__.py' 2023-03-07T18:32:34,695 adding 'deepspeed/launcher/constants.py' 2023-03-07T18:32:34,699 adding 'deepspeed/launcher/launch.py' 2023-03-07T18:32:34,704 adding 'deepspeed/launcher/multinode_runner.py' 2023-03-07T18:32:34,710 adding 'deepspeed/launcher/runner.py' 2023-03-07T18:32:34,714 adding 'deepspeed/model_implementations/__init__.py' 2023-03-07T18:32:34,718 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-03-07T18:32:34,721 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-03-07T18:32:34,724 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-03-07T18:32:34,727 adding 'deepspeed/model_implementations/features/__init__.py' 2023-03-07T18:32:34,730 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-03-07T18:32:34,733 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-03-07T18:32:34,736 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-03-07T18:32:34,739 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-03-07T18:32:34,741 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-03-07T18:32:34,744 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-03-07T18:32:34,746 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-03-07T18:32:34,749 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-03-07T18:32:34,751 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-03-07T18:32:34,755 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-03-07T18:32:34,759 adding 'deepspeed/module_inject/__init__.py' 2023-03-07T18:32:34,762 adding 'deepspeed/module_inject/auto_tp.py' 2023-03-07T18:32:34,765 adding 'deepspeed/module_inject/inject.py' 2023-03-07T18:32:34,768 adding 'deepspeed/module_inject/layers.py' 2023-03-07T18:32:34,772 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-03-07T18:32:34,776 adding 'deepspeed/module_inject/module_quantize.py' 2023-03-07T18:32:34,779 adding 'deepspeed/module_inject/policy.py' 2023-03-07T18:32:34,789 adding 'deepspeed/module_inject/replace_module.py' 2023-03-07T18:32:34,792 adding 'deepspeed/module_inject/replace_policy.py' 2023-03-07T18:32:34,795 adding 'deepspeed/module_inject/utils.py' 2023-03-07T18:32:34,799 adding 'deepspeed/module_inject/containers/__init__.py' 2023-03-07T18:32:34,803 adding 'deepspeed/module_inject/containers/base.py' 2023-03-07T18:32:34,806 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-03-07T18:32:34,809 adding 'deepspeed/module_inject/containers/bert.py' 2023-03-07T18:32:34,812 adding 'deepspeed/module_inject/containers/bloom.py' 2023-03-07T18:32:34,815 adding 'deepspeed/module_inject/containers/clip.py' 2023-03-07T18:32:34,818 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-03-07T18:32:34,821 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-03-07T18:32:34,824 adding 'deepspeed/module_inject/containers/gptj.py' 2023-03-07T18:32:34,827 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-03-07T18:32:34,831 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-03-07T18:32:34,834 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-03-07T18:32:34,837 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-03-07T18:32:34,841 adding 'deepspeed/module_inject/containers/opt.py' 2023-03-07T18:32:34,843 adding 'deepspeed/module_inject/containers/unet.py' 2023-03-07T18:32:34,846 adding 'deepspeed/module_inject/containers/vae.py' 2023-03-07T18:32:34,849 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-03-07T18:32:34,852 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-03-07T18:32:34,855 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-03-07T18:32:34,859 adding 'deepspeed/moe/__init__.py' 2023-03-07T18:32:34,861 adding 'deepspeed/moe/experts.py' 2023-03-07T18:32:34,864 adding 'deepspeed/moe/layer.py' 2023-03-07T18:32:34,868 adding 'deepspeed/moe/mappings.py' 2023-03-07T18:32:34,874 adding 'deepspeed/moe/sharded_moe.py' 2023-03-07T18:32:34,878 adding 'deepspeed/moe/utils.py' 2023-03-07T18:32:34,882 adding 'deepspeed/monitor/__init__.py' 2023-03-07T18:32:34,885 adding 'deepspeed/monitor/config.py' 2023-03-07T18:32:34,887 adding 'deepspeed/monitor/csv_monitor.py' 2023-03-07T18:32:34,890 adding 'deepspeed/monitor/monitor.py' 2023-03-07T18:32:34,893 adding 'deepspeed/monitor/tensorboard.py' 2023-03-07T18:32:34,895 adding 'deepspeed/monitor/utils.py' 2023-03-07T18:32:34,898 adding 'deepspeed/monitor/wandb.py' 2023-03-07T18:32:34,901 adding 'deepspeed/nebula/__init__.py' 2023-03-07T18:32:34,904 adding 'deepspeed/nebula/config.py' 2023-03-07T18:32:34,906 adding 'deepspeed/nebula/constants.py' 2023-03-07T18:32:34,910 adding 'deepspeed/ops/__init__.py' 2023-03-07T18:32:34,914 adding 'deepspeed/ops/adagrad/__init__.py' 2023-03-07T18:32:34,917 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-03-07T18:32:34,920 adding 'deepspeed/ops/adam/__init__.py' 2023-03-07T18:32:34,924 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-03-07T18:32:34,928 adding 'deepspeed/ops/adam/fused_adam.py' 2023-03-07T18:32:34,931 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-03-07T18:32:34,934 adding 'deepspeed/ops/aio/__init__.py' 2023-03-07T18:32:34,940 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-03-07T18:32:34,945 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-03-07T18:32:34,948 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-03-07T18:32:34,951 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-03-07T18:32:34,954 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-03-07T18:32:34,961 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-03-07T18:32:34,964 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-03-07T18:32:34,966 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-03-07T18:32:34,969 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-03-07T18:32:34,972 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-03-07T18:32:34,975 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-03-07T18:32:34,979 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-03-07T18:32:34,982 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-03-07T18:32:34,985 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-03-07T18:32:34,987 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-03-07T18:32:34,990 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-03-07T18:32:34,993 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-03-07T18:32:34,996 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-03-07T18:32:34,999 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-03-07T18:32:35,002 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-03-07T18:32:35,005 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-03-07T18:32:35,008 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-03-07T18:32:35,011 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-03-07T18:32:35,015 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-03-07T18:32:35,020 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-03-07T18:32:35,022 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-03-07T18:32:35,025 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-03-07T18:32:35,028 adding 'deepspeed/ops/csrc/includes/context.h' 2023-03-07T18:32:35,032 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-03-07T18:32:35,035 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-03-07T18:32:35,039 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-03-07T18:32:35,042 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-03-07T18:32:35,046 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-03-07T18:32:35,049 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-03-07T18:32:35,052 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-03-07T18:32:35,055 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-03-07T18:32:35,058 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-03-07T18:32:35,061 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-03-07T18:32:35,064 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-03-07T18:32:35,067 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-03-07T18:32:35,070 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-03-07T18:32:35,076 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-03-07T18:32:35,079 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-03-07T18:32:35,082 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-03-07T18:32:35,087 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-03-07T18:32:35,090 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-03-07T18:32:35,095 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-03-07T18:32:35,098 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-03-07T18:32:35,101 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-03-07T18:32:35,104 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-03-07T18:32:35,107 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-03-07T18:32:35,111 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-03-07T18:32:35,116 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-03-07T18:32:35,120 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-03-07T18:32:35,127 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-03-07T18:32:35,131 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-03-07T18:32:35,134 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-03-07T18:32:35,139 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-03-07T18:32:35,142 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-03-07T18:32:35,145 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-03-07T18:32:35,149 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-03-07T18:32:35,153 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-03-07T18:32:35,158 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-03-07T18:32:35,161 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-03-07T18:32:35,165 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-03-07T18:32:35,170 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-03-07T18:32:35,176 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-03-07T18:32:35,185 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-03-07T18:32:35,191 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-03-07T18:32:35,195 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-03-07T18:32:35,205 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-03-07T18:32:35,212 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-03-07T18:32:35,218 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-03-07T18:32:35,225 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-03-07T18:32:35,228 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-03-07T18:32:35,235 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-03-07T18:32:35,240 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-03-07T18:32:35,253 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-03-07T18:32:35,257 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-03-07T18:32:35,262 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-03-07T18:32:35,268 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-03-07T18:32:35,274 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-03-07T18:32:35,278 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-03-07T18:32:35,282 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-03-07T18:32:35,286 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-03-07T18:32:35,289 adding 'deepspeed/ops/lamb/__init__.py' 2023-03-07T18:32:35,293 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-03-07T18:32:35,297 adding 'deepspeed/ops/op_builder/__init__.py' 2023-03-07T18:32:35,300 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-03-07T18:32:35,303 adding 'deepspeed/ops/op_builder/async_io.py' 2023-03-07T18:32:35,311 adding 'deepspeed/ops/op_builder/builder.py' 2023-03-07T18:32:35,314 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-03-07T18:32:35,317 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-03-07T18:32:35,319 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-03-07T18:32:35,322 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-03-07T18:32:35,324 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-03-07T18:32:35,327 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-03-07T18:32:35,330 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-03-07T18:32:35,333 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-03-07T18:32:35,335 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-03-07T18:32:35,338 adding 'deepspeed/ops/op_builder/transformer.py' 2023-03-07T18:32:35,341 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-03-07T18:32:35,344 adding 'deepspeed/ops/op_builder/utils.py' 2023-03-07T18:32:35,347 adding 'deepspeed/ops/quantizer/__init__.py' 2023-03-07T18:32:35,349 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-03-07T18:32:35,353 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-03-07T18:32:35,356 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-03-07T18:32:35,360 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-03-07T18:32:35,363 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-03-07T18:32:35,372 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-03-07T18:32:35,377 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-03-07T18:32:35,382 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-03-07T18:32:35,385 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-03-07T18:32:35,393 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-03-07T18:32:35,398 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-03-07T18:32:35,401 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-03-07T18:32:35,404 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-03-07T18:32:35,407 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-03-07T18:32:35,410 adding 'deepspeed/ops/transformer/__init__.py' 2023-03-07T18:32:35,416 adding 'deepspeed/ops/transformer/transformer.py' 2023-03-07T18:32:35,421 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-03-07T18:32:35,423 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-03-07T18:32:35,426 adding 'deepspeed/ops/transformer/inference/config.py' 2023-03-07T18:32:35,429 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-03-07T18:32:35,433 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-03-07T18:32:35,436 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-03-07T18:32:35,440 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-03-07T18:32:35,443 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-03-07T18:32:35,449 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-03-07T18:32:35,453 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-03-07T18:32:35,456 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-03-07T18:32:35,459 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-03-07T18:32:35,462 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-03-07T18:32:35,464 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-03-07T18:32:35,467 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-03-07T18:32:35,469 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-03-07T18:32:35,472 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-03-07T18:32:35,475 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-03-07T18:32:35,477 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-03-07T18:32:35,480 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-03-07T18:32:35,483 adding 'deepspeed/pipe/__init__.py' 2023-03-07T18:32:35,487 adding 'deepspeed/profiling/__init__.py' 2023-03-07T18:32:35,489 adding 'deepspeed/profiling/config.py' 2023-03-07T18:32:35,492 adding 'deepspeed/profiling/constants.py' 2023-03-07T18:32:35,495 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-03-07T18:32:35,507 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-03-07T18:32:35,512 adding 'deepspeed/runtime/__init__.py' 2023-03-07T18:32:35,518 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-03-07T18:32:35,527 adding 'deepspeed/runtime/config.py' 2023-03-07T18:32:35,532 adding 'deepspeed/runtime/config_utils.py' 2023-03-07T18:32:35,536 adding 'deepspeed/runtime/constants.py' 2023-03-07T18:32:35,540 adding 'deepspeed/runtime/dataloader.py' 2023-03-07T18:32:35,543 adding 'deepspeed/runtime/eigenvalue.py' 2023-03-07T18:32:35,583 adding 'deepspeed/runtime/engine.py' 2023-03-07T18:32:35,595 adding 'deepspeed/runtime/lr_schedules.py' 2023-03-07T18:32:35,598 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-03-07T18:32:35,602 adding 'deepspeed/runtime/quantize.py' 2023-03-07T18:32:35,605 adding 'deepspeed/runtime/sparse_tensor.py' 2023-03-07T18:32:35,610 adding 'deepspeed/runtime/state_dict_factory.py' 2023-03-07T18:32:35,620 adding 'deepspeed/runtime/utils.py' 2023-03-07T18:32:35,624 adding 'deepspeed/runtime/weight_quantizer.py' 2023-03-07T18:32:35,628 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-03-07T18:32:35,637 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-03-07T18:32:35,640 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-03-07T18:32:35,644 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-03-07T18:32:35,646 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-03-07T18:32:35,649 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-03-07T18:32:35,652 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-03-07T18:32:35,655 adding 'deepspeed/runtime/comm/__init__.py' 2023-03-07T18:32:35,659 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-03-07T18:32:35,662 adding 'deepspeed/runtime/comm/mpi.py' 2023-03-07T18:32:35,666 adding 'deepspeed/runtime/comm/nccl.py' 2023-03-07T18:32:35,670 adding 'deepspeed/runtime/compression/__init__.py' 2023-03-07T18:32:35,672 adding 'deepspeed/runtime/compression/cupy.py' 2023-03-07T18:32:35,676 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-03-07T18:32:35,679 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-03-07T18:32:35,682 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-03-07T18:32:35,686 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-03-07T18:32:35,690 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-03-07T18:32:35,693 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-03-07T18:32:35,695 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-03-07T18:32:35,699 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-03-07T18:32:35,701 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-03-07T18:32:35,705 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-03-07T18:32:35,712 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-03-07T18:32:35,718 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-03-07T18:32:35,724 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-03-07T18:32:35,727 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-03-07T18:32:35,731 adding 'deepspeed/runtime/fp16/__init__.py' 2023-03-07T18:32:35,737 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-03-07T18:32:35,742 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-03-07T18:32:35,747 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-03-07T18:32:35,751 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-03-07T18:32:35,756 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-03-07T18:32:35,763 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-03-07T18:32:35,769 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-03-07T18:32:35,773 adding 'deepspeed/runtime/pipe/__init__.py' 2023-03-07T18:32:35,787 adding 'deepspeed/runtime/pipe/engine.py' 2023-03-07T18:32:35,797 adding 'deepspeed/runtime/pipe/module.py' 2023-03-07T18:32:35,801 adding 'deepspeed/runtime/pipe/p2p.py' 2023-03-07T18:32:35,805 adding 'deepspeed/runtime/pipe/schedule.py' 2023-03-07T18:32:35,811 adding 'deepspeed/runtime/pipe/topology.py' 2023-03-07T18:32:35,815 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-03-07T18:32:35,818 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-03-07T18:32:35,821 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-03-07T18:32:35,824 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-03-07T18:32:35,830 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-03-07T18:32:35,834 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-03-07T18:32:35,840 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-03-07T18:32:35,844 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-03-07T18:32:35,848 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-03-07T18:32:35,852 adding 'deepspeed/runtime/zero/__init__.py' 2023-03-07T18:32:35,856 adding 'deepspeed/runtime/zero/config.py' 2023-03-07T18:32:35,861 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-03-07T18:32:35,865 adding 'deepspeed/runtime/zero/linear.py' 2023-03-07T18:32:35,867 adding 'deepspeed/runtime/zero/offload_config.py' 2023-03-07T18:32:35,873 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-03-07T18:32:35,893 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-03-07T18:32:35,901 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-03-07T18:32:35,933 adding 'deepspeed/runtime/zero/stage3.py' 2023-03-07T18:32:35,966 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-03-07T18:32:35,971 adding 'deepspeed/runtime/zero/test.py' 2023-03-07T18:32:35,975 adding 'deepspeed/runtime/zero/tiling.py' 2023-03-07T18:32:35,978 adding 'deepspeed/runtime/zero/utils.py' 2023-03-07T18:32:35,982 adding 'deepspeed/utils/__init__.py' 2023-03-07T18:32:35,986 adding 'deepspeed/utils/comms_logging.py' 2023-03-07T18:32:35,989 adding 'deepspeed/utils/debug.py' 2023-03-07T18:32:35,991 adding 'deepspeed/utils/exceptions.py' 2023-03-07T18:32:35,996 adding 'deepspeed/utils/groups.py' 2023-03-07T18:32:35,999 adding 'deepspeed/utils/init_on_device.py' 2023-03-07T18:32:36,002 adding 'deepspeed/utils/logging.py' 2023-03-07T18:32:36,005 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-03-07T18:32:36,008 adding 'deepspeed/utils/nvtx.py' 2023-03-07T18:32:36,011 adding 'deepspeed/utils/tensor_fragment.py' 2023-03-07T18:32:36,015 adding 'deepspeed/utils/timer.py' 2023-03-07T18:32:36,018 adding 'deepspeed/utils/types.py' 2023-03-07T18:32:36,023 adding 'deepspeed/utils/zero_to_fp32.py' 2023-03-07T18:32:36,029 adding 'deepspeed-0.8.2.data/scripts/deepspeed' 2023-03-07T18:32:36,031 adding 'deepspeed-0.8.2.data/scripts/deepspeed.pt' 2023-03-07T18:32:36,033 adding 'deepspeed-0.8.2.data/scripts/ds' 2023-03-07T18:32:36,036 adding 'deepspeed-0.8.2.data/scripts/ds_bench' 2023-03-07T18:32:36,038 adding 'deepspeed-0.8.2.data/scripts/ds_elastic' 2023-03-07T18:32:36,041 adding 'deepspeed-0.8.2.data/scripts/ds_report' 2023-03-07T18:32:36,043 adding 'deepspeed-0.8.2.data/scripts/ds_ssh' 2023-03-07T18:32:36,045 adding 'deepspeed-0.8.2.data/scripts/dsr' 2023-03-07T18:32:36,050 adding 'deepspeed-0.8.2.dist-info/LICENSE' 2023-03-07T18:32:36,058 adding 'deepspeed-0.8.2.dist-info/METADATA' 2023-03-07T18:32:36,060 adding 'deepspeed-0.8.2.dist-info/WHEEL' 2023-03-07T18:32:36,062 adding 'deepspeed-0.8.2.dist-info/entry_points.txt' 2023-03-07T18:32:36,064 adding 'deepspeed-0.8.2.dist-info/top_level.txt' 2023-03-07T18:32:36,075 adding 'deepspeed-0.8.2.dist-info/RECORD' 2023-03-07T18:32:36,119 removing build/bdist.linux-armv7l/wheel 2023-03-07T18:32:36,341 deepspeed build time = 11.051321744918823 secs 2023-03-07T18:32:36,502 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-03-07T18:32:36,531 Created wheel for deepspeed: filename=deepspeed-0.8.2-py3-none-any.whl size=775172 sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e 2023-03-07T18:32:36,534 Stored in directory: /tmp/pip-ephem-wheel-cache-t6h5_4r9/wheels/31/24/ad/e6c2e49f7f8731cf939168e08b6cd7acb1fb5078e429a8ae24 2023-03-07T18:32:36,599 Successfully built deepspeed 2023-03-07T18:32:36,660 Removed build tracker: '/tmp/pip-build-tracker-pxy3sbu1'