2024-10-09T19:29:22,194 Disabling truststore because Python version isn't 3.10+
2024-10-09T19:29:22,704 Created temporary directory: /tmp/pip-build-tracker-654xqalk
2024-10-09T19:29:22,705 Initialized build tracking at /tmp/pip-build-tracker-654xqalk
2024-10-09T19:29:22,705 Created build tracker: /tmp/pip-build-tracker-654xqalk
2024-10-09T19:29:22,705 Entered build tracker: /tmp/pip-build-tracker-654xqalk
2024-10-09T19:29:22,706 Created temporary directory: /tmp/pip-wheel-_3y8u1p7
2024-10-09T19:29:22,711 Created temporary directory: /tmp/pip-ephem-wheel-cache-wn8bwzhk
2024-10-09T19:29:22,761 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-10-09T19:29:22,764 2 location(s) to search for versions of deepspeed:
2024-10-09T19:29:22,764 * https://pypi.org/simple/deepspeed/
2024-10-09T19:29:22,764 * https://www.piwheels.org/simple/deepspeed/
2024-10-09T19:29:22,765 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-10-09T19:29:22,765 Getting page https://pypi.org/simple/deepspeed/
2024-10-09T19:29:22,767 Found index url https://pypi.org/simple/
2024-10-09T19:29:22,791 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-10-09T19:29:22,808   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-09T19:29:22,809   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-10-09T19:29:22,809   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-09T19:29:22,809   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-10-09T19:29:22,810   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-09T19:29:22,810   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-10-09T19:29:22,810   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-09T19:29:22,810   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-10-09T19:29:22,811   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-09T19:29:22,811   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-10-09T19:29:22,811   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-10-09T19:29:22,811   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-10-09T19:29:22,812   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-10-09T19:29:22,812   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-10-09T19:29:22,812   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-10-09T19:29:22,812   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-10-09T19:29:22,813   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-10-09T19:29:22,813   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-10-09T19:29:22,813   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-10-09T19:29:22,814   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-10-09T19:29:22,814   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-10-09T19:29:22,814   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-10-09T19:29:22,814   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-10-09T19:29:22,815   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-10-09T19:29:22,815   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-10-09T19:29:22,815   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-10-09T19:29:22,815   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-10-09T19:29:22,816   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-10-09T19:29:22,816   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-10-09T19:29:22,816   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-10-09T19:29:22,816   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-10-09T19:29:22,817   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-10-09T19:29:22,817   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-10-09T19:29:22,817   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-10-09T19:29:22,817   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-10-09T19:29:22,818   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-10-09T19:29:22,818   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-10-09T19:29:22,818   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-10-09T19:29:22,818   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-10-09T19:29:22,819   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-10-09T19:29:22,819   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-10-09T19:29:22,819   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-10-09T19:29:22,819   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-10-09T19:29:22,820   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-10-09T19:29:22,820   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-10-09T19:29:22,820   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-10-09T19:29:22,821   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-10-09T19:29:22,821   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-10-09T19:29:22,821   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-10-09T19:29:22,821   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-10-09T19:29:22,822   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-10-09T19:29:22,822   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-10-09T19:29:22,822   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-10-09T19:29:22,822   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-10-09T19:29:22,823   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-10-09T19:29:22,823   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-10-09T19:29:22,823   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-10-09T19:29:22,823   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-10-09T19:29:22,824   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-10-09T19:29:22,824   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-10-09T19:29:22,824   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-10-09T19:29:22,825   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-10-09T19:29:22,825   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-10-09T19:29:22,825   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-10-09T19:29:22,825   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-10-09T19:29:22,826   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-10-09T19:29:22,826   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-10-09T19:29:22,826   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-10-09T19:29:22,826   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-10-09T19:29:22,827   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-10-09T19:29:22,827   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-10-09T19:29:22,827   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-10-09T19:29:22,827   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-10-09T19:29:22,828   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-10-09T19:29:22,828   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-10-09T19:29:22,828   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-10-09T19:29:22,828   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-10-09T19:29:22,829   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-10-09T19:29:22,829   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-10-09T19:29:22,829   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-10-09T19:29:22,829   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-10-09T19:29:22,830   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-10-09T19:29:22,830   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-10-09T19:29:22,830   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-10-09T19:29:22,830   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-10-09T19:29:22,831   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-10-09T19:29:22,831   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-10-09T19:29:22,831   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-10-09T19:29:22,832   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-10-09T19:29:22,832   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-10-09T19:29:22,832   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-10-09T19:29:22,832   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-10-09T19:29:22,833   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-10-09T19:29:22,833   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-10-09T19:29:22,833   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-10-09T19:29:22,833   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-10-09T19:29:22,834   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-10-09T19:29:22,834   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-10-09T19:29:22,834   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-10-09T19:29:22,834   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2024-10-09T19:29:22,835   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2024-10-09T19:29:22,835   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2024-10-09T19:29:22,835 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-10-09T19:29:22,835 Getting page https://www.piwheels.org/simple/deepspeed/
2024-10-09T19:29:22,836 Found index url https://www.piwheels.org/simple/
2024-10-09T19:29:22,883 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-10-09T19:29:22,901   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,902   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,902   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,902   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,902   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,902   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,903   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,903   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,903   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,903   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,903   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,904   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,904   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,904   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,904   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,904   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,905   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,905   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,905   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,905   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,905   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,906   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,906   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,906   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,906   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,906   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,906   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,907   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,907   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,907   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,907   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,907   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,908   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,908   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,908   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,908   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,908   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,909   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,909   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,909   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,909   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,909   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,909   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,910   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,910   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,910   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,910   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,910   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,911   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,911   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,911   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,911   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,911   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,913   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,913   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,913   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,913   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,913   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,914   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,914   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,914   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,914   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,914   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-09T19:29:22,915 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-10-09T19:29:22,915 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-10-09T19:29:22,942 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-10-09T19:29:22,945 Collecting deepspeed==0.15.2
2024-10-09T19:29:22,947   Created temporary directory: /tmp/pip-unpack-ljnhx1io
2024-10-09T19:29:22,975   Downloading deepspeed-0.15.2.tar.gz (1.4 MB)
2024-10-09T19:29:25,448   Added deepspeed==0.15.2 from https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz to build tracker '/tmp/pip-build-tracker-654xqalk'
2024-10-09T19:29:25,450   Running setup.py (path:/tmp/pip-wheel-_3y8u1p7/deepspeed_5135aa38c3554e93ba7ea0f79fbc82a1/setup.py) egg_info for package deepspeed
2024-10-09T19:29:25,451   Created temporary directory: /tmp/pip-pip-egg-info-6llvi732
2024-10-09T19:29:25,451   Preparing metadata (setup.py): started
2024-10-09T19:29:25,452   Running command python setup.py egg_info
2024-10-09T19:29:26,977   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-10-09T19:29:26,978    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-10-09T19:29:26,978   DS_BUILD_OPS=0
2024-10-09T19:29:26,978   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-10-09T19:29:26,979   version=0.15.2, git_hash=unknown, git_branch=unknown
2024-10-09T19:29:26,979   install_requires=['hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-10-09T19:29:26,979   ext_modules=[]
2024-10-09T19:29:26,979   running egg_info
2024-10-09T19:29:26,979   creating /tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info
2024-10-09T19:29:27,005   writing /tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info/PKG-INFO
2024-10-09T19:29:27,051   writing dependency_links to /tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info/dependency_links.txt
2024-10-09T19:29:27,053   writing entry points to /tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info/entry_points.txt
2024-10-09T19:29:27,077   writing requirements to /tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info/requires.txt
2024-10-09T19:29:27,078   writing top-level names to /tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info/top_level.txt
2024-10-09T19:29:27,079   writing manifest file '/tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info/SOURCES.txt'
2024-10-09T19:29:27,323   reading manifest file '/tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info/SOURCES.txt'
2024-10-09T19:29:27,325   reading manifest template 'MANIFEST.in'
2024-10-09T19:29:27,327   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-10-09T19:29:27,328   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-10-09T19:29:28,972   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-10-09T19:29:29,926   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-10-09T19:29:30,593   warning: no files found matching '*.tr' under directory 'csrc'
2024-10-09T19:29:30,714   warning: no files found matching '*.cc' under directory 'csrc'
2024-10-09T19:29:30,759   warning: no files found matching '*.py' under directory 'benchmarks'
2024-10-09T19:29:30,765   adding license file 'LICENSE'
2024-10-09T19:29:30,815   writing manifest file '/tmp/pip-pip-egg-info-6llvi732/deepspeed.egg-info/SOURCES.txt'
2024-10-09T19:29:30,817   deepspeed build time = 4.378220319747925 secs
2024-10-09T19:29:30,912   Preparing metadata (setup.py): finished with status 'done'
2024-10-09T19:29:30,919   Source in /tmp/pip-wheel-_3y8u1p7/deepspeed_5135aa38c3554e93ba7ea0f79fbc82a1 has version 0.15.2, which satisfies requirement deepspeed==0.15.2 from https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz
2024-10-09T19:29:30,920   Removed deepspeed==0.15.2 from https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz from build tracker '/tmp/pip-build-tracker-654xqalk'
2024-10-09T19:29:30,955 Created temporary directory: /tmp/pip-unpack-7qtq7fd1
2024-10-09T19:29:30,956 Created temporary directory: /tmp/pip-unpack-jbsm_wi7
2024-10-09T19:29:30,956 Building wheels for collected packages: deepspeed
2024-10-09T19:29:30,960   Created temporary directory: /tmp/pip-wheel-xao2rgxt
2024-10-09T19:29:30,960   Building wheel for deepspeed (setup.py): started
2024-10-09T19:29:30,961   Destination directory: /tmp/pip-wheel-xao2rgxt
2024-10-09T19:29:30,961   Running command python setup.py bdist_wheel
2024-10-09T19:29:31,458   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-10-09T19:29:31,468    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-10-09T19:29:31,560   DS_BUILD_OPS=0
2024-10-09T19:29:31,687   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-10-09T19:29:31,715   version=0.15.2, git_hash=unknown, git_branch=unknown
2024-10-09T19:29:31,716   install_requires=['hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-10-09T19:29:31,716   ext_modules=[]
2024-10-09T19:29:32,187   running bdist_wheel
2024-10-09T19:29:32,318   running build
2024-10-09T19:29:32,318   running build_py
2024-10-09T19:29:32,348   creating build
2024-10-09T19:29:32,349   creating build/lib
2024-10-09T19:29:32,349   creating build/lib/deepspeed
2024-10-09T19:29:32,351   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-10-09T19:29:32,352   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-10-09T19:29:32,354   copying deepspeed/constants.py -> build/lib/deepspeed
2024-10-09T19:29:32,355   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-10-09T19:29:32,357   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-10-09T19:29:32,360   creating build/lib/deepspeed/nebula
2024-10-09T19:29:32,361   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-10-09T19:29:32,362   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-10-09T19:29:32,364   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-10-09T19:29:32,367   creating build/lib/deepspeed/utils
2024-10-09T19:29:32,368   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,369   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,372   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,373   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,375   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,377   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,379   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,380   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,382   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,385   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,386   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,388   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,390   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,391   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,394   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,396   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,397   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,400   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-10-09T19:29:32,402   creating build/lib/deepspeed/linear
2024-10-09T19:29:32,403   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-10-09T19:29:32,405   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-10-09T19:29:32,407   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-10-09T19:29:32,409   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-10-09T19:29:32,411   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-10-09T19:29:32,413   creating build/lib/deepspeed/inference
2024-10-09T19:29:32,414   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-10-09T19:29:32,417   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-10-09T19:29:32,418   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-10-09T19:29:32,421   creating build/lib/deepspeed/module_inject
2024-10-09T19:29:32,422   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,424   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,426   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,427   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,429   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,432   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,433   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,435   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,437   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,439   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,441   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,443   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,445   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-10-09T19:29:32,448   creating build/lib/deepspeed/elasticity
2024-10-09T19:29:32,449   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-10-09T19:29:32,451   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-10-09T19:29:32,454   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-10-09T19:29:32,455   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-10-09T19:29:32,457   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-10-09T19:29:32,458   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-10-09T19:29:32,461   creating build/lib/deepspeed/comm
2024-10-09T19:29:32,462   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,465   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,466   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,468   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,470   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,472   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,474   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,475   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,477   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-10-09T19:29:32,479   creating build/lib/deepspeed/autotuning
2024-10-09T19:29:32,480   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-10-09T19:29:32,483   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-10-09T19:29:32,485   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-10-09T19:29:32,488   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-10-09T19:29:32,490   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-10-09T19:29:32,492   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-10-09T19:29:32,494   creating build/lib/deepspeed/model_implementations
2024-10-09T19:29:32,495   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-10-09T19:29:32,497   creating build/lib/deepspeed/sequence
2024-10-09T19:29:32,498   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-10-09T19:29:32,500   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-10-09T19:29:32,502   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2024-10-09T19:29:32,504   creating build/lib/deepspeed/moe
2024-10-09T19:29:32,505   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-10-09T19:29:32,507   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-10-09T19:29:32,509   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-10-09T19:29:32,511   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-10-09T19:29:32,513   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-10-09T19:29:32,514   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-10-09T19:29:32,518   creating build/lib/deepspeed/launcher
2024-10-09T19:29:32,518   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-10-09T19:29:32,521   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-10-09T19:29:32,524   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-10-09T19:29:32,525   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-10-09T19:29:32,527   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-10-09T19:29:32,529   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-10-09T19:29:32,532   creating build/lib/deepspeed/accelerator
2024-10-09T19:29:32,533   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,535   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,538   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,540   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,542   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,544   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,546   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,548   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,550   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,552   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-09T19:29:32,555   creating build/lib/deepspeed/pipe
2024-10-09T19:29:32,555   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-10-09T19:29:32,558   creating build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,559   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,561   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,563   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,565   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,568   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,570   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,572   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,574   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,577   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,579   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-10-09T19:29:32,582   creating build/lib/deepspeed/ops
2024-10-09T19:29:32,583   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-10-09T19:29:32,586   creating build/lib/deepspeed/compression
2024-10-09T19:29:32,587   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-10-09T19:29:32,589   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-10-09T19:29:32,591   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-10-09T19:29:32,593   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-10-09T19:29:32,596   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-10-09T19:29:32,599   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-10-09T19:29:32,601   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-10-09T19:29:32,603   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-10-09T19:29:32,606   creating build/lib/deepspeed/nvme
2024-10-09T19:29:32,607   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,609   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,611   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,613   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,615   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,617   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,619   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,622   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,624   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,625   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,627   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,629   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2024-10-09T19:29:32,632   creating build/lib/deepspeed/monitor
2024-10-09T19:29:32,633   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-10-09T19:29:32,635   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-10-09T19:29:32,636   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-10-09T19:29:32,638   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-10-09T19:29:32,639   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-10-09T19:29:32,641   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-10-09T19:29:32,643   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-10-09T19:29:32,645   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-10-09T19:29:32,647   creating build/lib/deepspeed/profiling
2024-10-09T19:29:32,648   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-10-09T19:29:32,650   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-10-09T19:29:32,651   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-10-09T19:29:32,654   creating build/lib/deepspeed/runtime
2024-10-09T19:29:32,655   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,657   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,659   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,662   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,664   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,667   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,670   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,672   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,675   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,678   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,684   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,686   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,688   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,690   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,693   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,695   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,698   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,701   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-10-09T19:29:32,704   creating build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,705   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,707   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,709   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,711   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,713   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,715   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,717   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,719   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,721   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-10-09T19:29:32,724   creating build/lib/deepspeed/inference/quantization
2024-10-09T19:29:32,725   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-10-09T19:29:32,728   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-10-09T19:29:32,730   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-10-09T19:29:32,733   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-10-09T19:29:32,735   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-10-09T19:29:32,737   creating build/lib/deepspeed/inference/v2/kernels
2024-10-09T19:29:32,738   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-10-09T19:29:32,740   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-10-09T19:29:32,743   creating build/lib/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:32,743   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:32,746   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:32,748   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:32,750   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:32,752   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:32,754   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:32,757   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:32,759   creating build/lib/deepspeed/inference/v2/ragged
2024-10-09T19:29:32,761   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-09T19:29:32,763   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-09T19:29:32,765   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-09T19:29:32,767   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-09T19:29:32,769   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-09T19:29:32,771   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-09T19:29:32,773   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-09T19:29:32,776   creating build/lib/deepspeed/inference/v2/checkpoint
2024-10-09T19:29:32,777   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-10-09T19:29:32,778   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-10-09T19:29:32,780   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-10-09T19:29:32,782   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-10-09T19:29:32,785   creating build/lib/deepspeed/inference/v2/modules
2024-10-09T19:29:32,785   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-10-09T19:29:32,788   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-10-09T19:29:32,789   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-10-09T19:29:32,791   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-10-09T19:29:32,793   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-10-09T19:29:32,794   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-10-09T19:29:32,797   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-10-09T19:29:32,798   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-10-09T19:29:32,800   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-10-09T19:29:32,801   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-10-09T19:29:32,803   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:32,804   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:32,806   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:32,808   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:32,809   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:32,811   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:32,813   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:32,814   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:32,816   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:32,818   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:32,819   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:32,821   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:32,822   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:32,824   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:32,826   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:32,828   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:32,829   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:32,831   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:32,833   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:32,834   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:32,836   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:32,837   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:32,839   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:32,841   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:32,842   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:32,844   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:32,845   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:32,848   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:32,849   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:32,851   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:32,853   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:32,853   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:32,855   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:32,857   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:32,858   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:32,860   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:32,862   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:32,863   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:32,865   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:32,867   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:32,869   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:32,871   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:32,872   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:32,874   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:32,876   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:32,877   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:32,879   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:32,881   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:32,882   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:32,884   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:32,886   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:32,887   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:32,889   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:32,891   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:32,892   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:32,894   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:32,896   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:32,897   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:32,899   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:32,901   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:32,902   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:32,905   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:32,906   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:32,907   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:32,909   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:32,911   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:32,914   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:32,914   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:32,916   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:32,918   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:32,920   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:32,922   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:32,923   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:32,925   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:32,927   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:32,929   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:32,931   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:32,932   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:32,934   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:32,936   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:32,938   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:32,940   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:32,941   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:32,943   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:32,945   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:32,947   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:32,949   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:32,950   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:32,951   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:32,953   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:32,955   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:32,957   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:32,958   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:32,960   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:32,962   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:32,964   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:32,966   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:32,967   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:32,969   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:32,971   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:32,972   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:32,974   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:32,975   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:32,977   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:32,979   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:32,981   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:32,983   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,984   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,986   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,988   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,989   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,991   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,993   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,994   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,996   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:32,998   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:33,000   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,001   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,003   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,005   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,007   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,009   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,011   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,013   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,014   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,016   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:33,018   creating build/lib/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:33,019   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:33,021   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:33,023   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:33,025   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:33,026   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:33,028   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:33,030   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:33,033   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,034   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,035   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,037   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,039   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,041   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,043   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,045   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,046   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:33,049   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-10-09T19:29:33,049   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-10-09T19:29:33,052   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-10-09T19:29:33,053   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-10-09T19:29:33,055   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-10-09T19:29:33,057   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-10-09T19:29:33,059   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-10-09T19:29:33,060   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-10-09T19:29:33,062   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-10-09T19:29:33,065   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-10-09T19:29:33,065   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-10-09T19:29:33,067   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-10-09T19:29:33,070   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-10-09T19:29:33,071   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-10-09T19:29:33,074   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-10-09T19:29:33,076   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-10-09T19:29:33,077   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-10-09T19:29:33,079   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-10-09T19:29:33,082   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-10-09T19:29:33,082   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-10-09T19:29:33,085   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-10-09T19:29:33,087   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-09T19:29:33,088   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-09T19:29:33,089   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-09T19:29:33,091   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-09T19:29:33,094   creating build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,095   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,097   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,099   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,102   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,104   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,106   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,107   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,109   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,112   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,114   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,116   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,118   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,121   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,123   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,125   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,126   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,128   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,130   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,132   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-10-09T19:29:33,135   creating build/lib/deepspeed/module_inject/containers/features
2024-10-09T19:29:33,136   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-09T19:29:33,139   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-09T19:29:33,141   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-09T19:29:33,143   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-09T19:29:33,145   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-09T19:29:33,147   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-09T19:29:33,148   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-09T19:29:33,151   creating build/lib/deepspeed/autotuning/tuner
2024-10-09T19:29:33,152   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-10-09T19:29:33,154   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-10-09T19:29:33,156   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-10-09T19:29:33,158   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-10-09T19:29:33,160   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-10-09T19:29:33,162   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-10-09T19:29:33,164   creating build/lib/deepspeed/model_implementations/diffusers
2024-10-09T19:29:33,165   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-10-09T19:29:33,167   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-10-09T19:29:33,169   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-10-09T19:29:33,171   creating build/lib/deepspeed/model_implementations/features
2024-10-09T19:29:33,172   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-10-09T19:29:33,174   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-10-09T19:29:33,177   creating build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,178   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,180   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,182   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,183   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,185   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,187   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,189   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,190   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,192   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,194   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-09T19:29:33,196   creating build/lib/deepspeed/ops/adam
2024-10-09T19:29:33,197   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-10-09T19:29:33,200   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-10-09T19:29:33,202   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-10-09T19:29:33,203   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-10-09T19:29:33,206   creating build/lib/deepspeed/ops/aio
2024-10-09T19:29:33,207   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-10-09T19:29:33,209   creating build/lib/deepspeed/ops/gds
2024-10-09T19:29:33,210   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2024-10-09T19:29:33,213   creating build/lib/deepspeed/ops/sparse_attention
2024-10-09T19:29:33,214   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-09T19:29:33,217   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-09T19:29:33,219   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-09T19:29:33,221   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-09T19:29:33,223   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-09T19:29:33,225   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-09T19:29:33,227   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-09T19:29:33,230   creating build/lib/deepspeed/ops/quantizer
2024-10-09T19:29:33,231   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-10-09T19:29:33,233   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-10-09T19:29:33,235   creating build/lib/deepspeed/ops/lion
2024-10-09T19:29:33,236   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-10-09T19:29:33,239   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-10-09T19:29:33,240   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-10-09T19:29:33,242   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-10-09T19:29:33,245   creating build/lib/deepspeed/ops/lamb
2024-10-09T19:29:33,246   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-10-09T19:29:33,248   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-10-09T19:29:33,250   creating build/lib/deepspeed/ops/deepspeed4science
2024-10-09T19:29:33,251   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-10-09T19:29:33,253   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-10-09T19:29:33,256   creating build/lib/deepspeed/ops/adagrad
2024-10-09T19:29:33,257   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-10-09T19:29:33,258   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-10-09T19:29:33,261   creating build/lib/deepspeed/ops/fp_quantizer
2024-10-09T19:29:33,262   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-10-09T19:29:33,264   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-10-09T19:29:33,266   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-10-09T19:29:33,269   creating build/lib/deepspeed/ops/random_ltd
2024-10-09T19:29:33,270   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-10-09T19:29:33,272   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-10-09T19:29:33,275   creating build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,276   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,278   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,280   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,282   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,283   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,285   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,288   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,289   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,291   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,293   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,295   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,297   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,299   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,301   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,303   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,305   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,306   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,308   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,310   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,313   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,314   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,316   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,318   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,320   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-10-09T19:29:33,322   creating build/lib/deepspeed/ops/transformer
2024-10-09T19:29:33,323   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-10-09T19:29:33,326   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-10-09T19:29:33,328   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:33,329   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:33,331   creating build/lib/deepspeed/ops/op_builder/hpu
2024-10-09T19:29:33,332   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-09T19:29:33,334   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-09T19:29:33,336   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-09T19:29:33,337   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-09T19:29:33,339   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-09T19:29:33,341   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-09T19:29:33,343   creating build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,344   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,346   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,348   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,350   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,352   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,353   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,355   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,357   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,358   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-09T19:29:33,361   creating build/lib/deepspeed/ops/op_builder/cpu
2024-10-09T19:29:33,362   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-09T19:29:33,363   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-09T19:29:33,365   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-09T19:29:33,367   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-09T19:29:33,368   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-09T19:29:33,370   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-09T19:29:33,373   creating build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,374   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,375   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,377   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,379   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,381   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,382   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,384   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,386   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,387   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,389   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:33,392   creating build/lib/deepspeed/ops/op_builder/mlu
2024-10-09T19:29:33,393   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-09T19:29:33,395   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-09T19:29:33,396   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-09T19:29:33,398   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-09T19:29:33,399   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-09T19:29:33,401   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-09T19:29:33,404   creating build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,406   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,407   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,409   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,412   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,414   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,417   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,419   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,421   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,423   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,425   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-09T19:29:33,428   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,429   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,431   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,433   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,435   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,437   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,439   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,441   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,443   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,445   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,447   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:33,451   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,452   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,454   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,456   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,457   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,459   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,461   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,463   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,466   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,467   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,469   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,471   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,473   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,475   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,477   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,478   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,481   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,483   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,485   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,486   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,488   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,490   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,492   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,494   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:33,496   creating build/lib/deepspeed/profiling/flops_profiler
2024-10-09T19:29:33,497   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-10-09T19:29:33,500   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-10-09T19:29:33,503   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-10-09T19:29:33,504   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-10-09T19:29:33,506   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-10-09T19:29:33,507   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-10-09T19:29:33,511   creating build/lib/deepspeed/runtime/comm
2024-10-09T19:29:33,512   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-10-09T19:29:33,514   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-10-09T19:29:33,516   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-10-09T19:29:33,518   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-10-09T19:29:33,521   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-10-09T19:29:33,522   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-10-09T19:29:33,525   creating build/lib/deepspeed/runtime/fp16
2024-10-09T19:29:33,526   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-10-09T19:29:33,528   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-10-09T19:29:33,530   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-10-09T19:29:33,533   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-10-09T19:29:33,536   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:33,537   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:33,539   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:33,541   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:33,543   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:33,545   creating build/lib/deepspeed/runtime/pipe
2024-10-09T19:29:33,546   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-10-09T19:29:33,549   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-10-09T19:29:33,551   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-10-09T19:29:33,554   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-10-09T19:29:33,556   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-10-09T19:29:33,558   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-10-09T19:29:33,562   creating build/lib/deepspeed/runtime/data_pipeline
2024-10-09T19:29:33,563   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-10-09T19:29:33,565   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-10-09T19:29:33,566   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-10-09T19:29:33,569   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-10-09T19:29:33,571   creating build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,573   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,575   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,577   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,579   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,581   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,584   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,586   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,588   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,590   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-09T19:29:33,592   creating build/lib/deepspeed/runtime/compression
2024-10-09T19:29:33,593   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-10-09T19:29:33,595   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-10-09T19:29:33,598   creating build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,598   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,601   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,606   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,608   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,612   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,615   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,617   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,622   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,624   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,626   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,628   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,630   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,633   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,635   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,638   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,640   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-10-09T19:29:33,643   creating build/lib/deepspeed/runtime/fp16/onebit
2024-10-09T19:29:33,644   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-10-09T19:29:33,647   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-10-09T19:29:33,649   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-10-09T19:29:33,651   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-10-09T19:29:33,654   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:33,655   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:33,659   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:33,662   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:33,665   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:33,666   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:33,669   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:33,670   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:33,672   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:33,674   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:33,675   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:33,677   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:33,680   running egg_info
2024-10-09T19:29:33,706   writing deepspeed.egg-info/PKG-INFO
2024-10-09T19:29:33,753   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-10-09T19:29:33,755   writing entry points to deepspeed.egg-info/entry_points.txt
2024-10-09T19:29:33,782   writing requirements to deepspeed.egg-info/requires.txt
2024-10-09T19:29:33,784   writing top-level names to deepspeed.egg-info/top_level.txt
2024-10-09T19:29:33,934   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-10-09T19:29:34,032   reading manifest template 'MANIFEST.in'
2024-10-09T19:29:34,034   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-10-09T19:29:34,034   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-10-09T19:29:35,664   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-10-09T19:29:36,670   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-10-09T19:29:37,345   warning: no files found matching '*.tr' under directory 'csrc'
2024-10-09T19:29:37,470   warning: no files found matching '*.cc' under directory 'csrc'
2024-10-09T19:29:37,512   warning: no files found matching '*.py' under directory 'benchmarks'
2024-10-09T19:29:37,518   adding license file 'LICENSE'
2024-10-09T19:29:37,586   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-10-09T19:29:37,597   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-10-09T19:29:37,598   !!

2024-10-09T19:29:37,598           ********************************************************************************
2024-10-09T19:29:37,598           ############################
2024-10-09T19:29:37,598           # Package would be ignored #
2024-10-09T19:29:37,598           ############################
2024-10-09T19:29:37,598           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-10-09T19:29:37,598           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,599           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,599           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-10-09T19:29:37,599           to the `packages` configuration field.

2024-10-09T19:29:37,599           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,599           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,599           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,600           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,600           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,600           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-10-09T19:29:37,600           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-10-09T19:29:37,600           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,600           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,601           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,601           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,601           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,601           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,601                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,602                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,602                 directory, all directories are treated like packages.
2024-10-09T19:29:37,602           ********************************************************************************

2024-10-09T19:29:37,602   !!
2024-10-09T19:29:37,602     check.warn(importable)
2024-10-09T19:29:37,602   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-10-09T19:29:37,602   !!

2024-10-09T19:29:37,603           ********************************************************************************
2024-10-09T19:29:37,603           ############################
2024-10-09T19:29:37,603           # Package would be ignored #
2024-10-09T19:29:37,603           ############################
2024-10-09T19:29:37,603           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-10-09T19:29:37,603           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,604           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,604           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-10-09T19:29:37,604           to the `packages` configuration field.

2024-10-09T19:29:37,604           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,604           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,604           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,604           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,605           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,605           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-10-09T19:29:37,605           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-10-09T19:29:37,605           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,605           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,605           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,606           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,606           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,606           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,606                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,606                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,606                 directory, all directories are treated like packages.
2024-10-09T19:29:37,607           ********************************************************************************

2024-10-09T19:29:37,607   !!
2024-10-09T19:29:37,607     check.warn(importable)
2024-10-09T19:29:37,607   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-10-09T19:29:37,607   !!

2024-10-09T19:29:37,607           ********************************************************************************
2024-10-09T19:29:37,607           ############################
2024-10-09T19:29:37,608           # Package would be ignored #
2024-10-09T19:29:37,608           ############################
2024-10-09T19:29:37,608           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-10-09T19:29:37,608           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,608           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,608           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-10-09T19:29:37,608           to the `packages` configuration field.

2024-10-09T19:29:37,608           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,609           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,609           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,609           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,609           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,609           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-10-09T19:29:37,609           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-10-09T19:29:37,610           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,610           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,610           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,610           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,610           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,611           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,611                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,611                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,611                 directory, all directories are treated like packages.
2024-10-09T19:29:37,611           ********************************************************************************

2024-10-09T19:29:37,611   !!
2024-10-09T19:29:37,611     check.warn(importable)
2024-10-09T19:29:37,612   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-10-09T19:29:37,612   !!

2024-10-09T19:29:37,612           ********************************************************************************
2024-10-09T19:29:37,612           ############################
2024-10-09T19:29:37,612           # Package would be ignored #
2024-10-09T19:29:37,612           ############################
2024-10-09T19:29:37,612           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-10-09T19:29:37,612           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,613           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,613           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-10-09T19:29:37,613           to the `packages` configuration field.

2024-10-09T19:29:37,613           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,613           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,613           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,614           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,614           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,614           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-10-09T19:29:37,614           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-10-09T19:29:37,614           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,614           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,614           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,615           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,615           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,615           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,615                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,615                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,616                 directory, all directories are treated like packages.
2024-10-09T19:29:37,616           ********************************************************************************

2024-10-09T19:29:37,616   !!
2024-10-09T19:29:37,616     check.warn(importable)
2024-10-09T19:29:37,616   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-10-09T19:29:37,616   !!

2024-10-09T19:29:37,617           ********************************************************************************
2024-10-09T19:29:37,617           ############################
2024-10-09T19:29:37,617           # Package would be ignored #
2024-10-09T19:29:37,617           ############################
2024-10-09T19:29:37,617           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-10-09T19:29:37,617           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,617           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,617           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-10-09T19:29:37,618           to the `packages` configuration field.

2024-10-09T19:29:37,618           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,618           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,618           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,618           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,618           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,619           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-10-09T19:29:37,619           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-10-09T19:29:37,619           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,619           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,619           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,619           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,620           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,620           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,620                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,620                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,620                 directory, all directories are treated like packages.
2024-10-09T19:29:37,620           ********************************************************************************

2024-10-09T19:29:37,621   !!
2024-10-09T19:29:37,621     check.warn(importable)
2024-10-09T19:29:37,621   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-10-09T19:29:37,621   !!

2024-10-09T19:29:37,621           ********************************************************************************
2024-10-09T19:29:37,621           ############################
2024-10-09T19:29:37,621           # Package would be ignored #
2024-10-09T19:29:37,621           ############################
2024-10-09T19:29:37,621           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-10-09T19:29:37,622           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,622           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,622           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-10-09T19:29:37,622           to the `packages` configuration field.

2024-10-09T19:29:37,622           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,622           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,622           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,623           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,623           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,623           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-10-09T19:29:37,623           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-10-09T19:29:37,623           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,623           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,623           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,624           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,624           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,624           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,624                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,624                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,624                 directory, all directories are treated like packages.
2024-10-09T19:29:37,625           ********************************************************************************

2024-10-09T19:29:37,625   !!
2024-10-09T19:29:37,625     check.warn(importable)
2024-10-09T19:29:37,625   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-10-09T19:29:37,625   !!

2024-10-09T19:29:37,625           ********************************************************************************
2024-10-09T19:29:37,625           ############################
2024-10-09T19:29:37,626           # Package would be ignored #
2024-10-09T19:29:37,626           ############################
2024-10-09T19:29:37,626           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-10-09T19:29:37,626           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,626           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,626           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-10-09T19:29:37,626           to the `packages` configuration field.

2024-10-09T19:29:37,626           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,627           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,627           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,627           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,627           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,627           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-10-09T19:29:37,627           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-10-09T19:29:37,628           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,628           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,628           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,628           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,628           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,628           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,629                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,629                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,629                 directory, all directories are treated like packages.
2024-10-09T19:29:37,629           ********************************************************************************

2024-10-09T19:29:37,629   !!
2024-10-09T19:29:37,629     check.warn(importable)
2024-10-09T19:29:37,629   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-10-09T19:29:37,629   !!

2024-10-09T19:29:37,630           ********************************************************************************
2024-10-09T19:29:37,630           ############################
2024-10-09T19:29:37,630           # Package would be ignored #
2024-10-09T19:29:37,630           ############################
2024-10-09T19:29:37,630           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-10-09T19:29:37,630           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,630           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,630           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-10-09T19:29:37,631           to the `packages` configuration field.

2024-10-09T19:29:37,631           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,631           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,631           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,631           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,631           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,632           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-10-09T19:29:37,632           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-10-09T19:29:37,632           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,632           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,632           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,632           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,632           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,633           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,633                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,633                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,633                 directory, all directories are treated like packages.
2024-10-09T19:29:37,633           ********************************************************************************

2024-10-09T19:29:37,633   !!
2024-10-09T19:29:37,634     check.warn(importable)
2024-10-09T19:29:37,634   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-10-09T19:29:37,634   !!

2024-10-09T19:29:37,634           ********************************************************************************
2024-10-09T19:29:37,634           ############################
2024-10-09T19:29:37,634           # Package would be ignored #
2024-10-09T19:29:37,634           ############################
2024-10-09T19:29:37,635           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-10-09T19:29:37,635           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,635           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,635           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-10-09T19:29:37,635           to the `packages` configuration field.

2024-10-09T19:29:37,635           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,635           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,635           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,636           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,636           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,636           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-10-09T19:29:37,636           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-10-09T19:29:37,636           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,636           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,637           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,637           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,637           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,637           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,637                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,638                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,638                 directory, all directories are treated like packages.
2024-10-09T19:29:37,638           ********************************************************************************

2024-10-09T19:29:37,638   !!
2024-10-09T19:29:37,638     check.warn(importable)
2024-10-09T19:29:37,638   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-10-09T19:29:37,638   !!

2024-10-09T19:29:37,638           ********************************************************************************
2024-10-09T19:29:37,639           ############################
2024-10-09T19:29:37,639           # Package would be ignored #
2024-10-09T19:29:37,639           ############################
2024-10-09T19:29:37,639           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-10-09T19:29:37,639           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,639           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,639           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-10-09T19:29:37,639           to the `packages` configuration field.

2024-10-09T19:29:37,640           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,640           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,640           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,640           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,640           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,640           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-10-09T19:29:37,641           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-10-09T19:29:37,641           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,641           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,641           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,641           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,641           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,642           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,642                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,642                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,642                 directory, all directories are treated like packages.
2024-10-09T19:29:37,642           ********************************************************************************

2024-10-09T19:29:37,642   !!
2024-10-09T19:29:37,642     check.warn(importable)
2024-10-09T19:29:37,642   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-10-09T19:29:37,643   !!

2024-10-09T19:29:37,643           ********************************************************************************
2024-10-09T19:29:37,643           ############################
2024-10-09T19:29:37,643           # Package would be ignored #
2024-10-09T19:29:37,643           ############################
2024-10-09T19:29:37,643           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-10-09T19:29:37,643           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,643           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,644           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-10-09T19:29:37,644           to the `packages` configuration field.

2024-10-09T19:29:37,644           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,644           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,644           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,644           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,645           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,645           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-10-09T19:29:37,645           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-10-09T19:29:37,645           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,645           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,645           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,645           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,646           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,646           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,646                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,646                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,646                 directory, all directories are treated like packages.
2024-10-09T19:29:37,646           ********************************************************************************

2024-10-09T19:29:37,646   !!
2024-10-09T19:29:37,647     check.warn(importable)
2024-10-09T19:29:37,647   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-10-09T19:29:37,647   !!

2024-10-09T19:29:37,647           ********************************************************************************
2024-10-09T19:29:37,647           ############################
2024-10-09T19:29:37,647           # Package would be ignored #
2024-10-09T19:29:37,647           ############################
2024-10-09T19:29:37,647           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-10-09T19:29:37,647           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,648           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,648           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-10-09T19:29:37,648           to the `packages` configuration field.

2024-10-09T19:29:37,648           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,648           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,648           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,649           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,649           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,649           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-10-09T19:29:37,649           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-10-09T19:29:37,649           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,649           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,649           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,650           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,650           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,650           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,650                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,651                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,651                 directory, all directories are treated like packages.
2024-10-09T19:29:37,651           ********************************************************************************

2024-10-09T19:29:37,651   !!
2024-10-09T19:29:37,651     check.warn(importable)
2024-10-09T19:29:37,651   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-10-09T19:29:37,651   !!

2024-10-09T19:29:37,652           ********************************************************************************
2024-10-09T19:29:37,652           ############################
2024-10-09T19:29:37,652           # Package would be ignored #
2024-10-09T19:29:37,652           ############################
2024-10-09T19:29:37,652           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-10-09T19:29:37,652           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,652           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,652           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-10-09T19:29:37,652           to the `packages` configuration field.

2024-10-09T19:29:37,653           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,653           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,653           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,653           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,653           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,654           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-10-09T19:29:37,654           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-10-09T19:29:37,654           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,654           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,654           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,654           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,654           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,655           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,655                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,655                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,655                 directory, all directories are treated like packages.
2024-10-09T19:29:37,655           ********************************************************************************

2024-10-09T19:29:37,655   !!
2024-10-09T19:29:37,655     check.warn(importable)
2024-10-09T19:29:37,655   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-10-09T19:29:37,656   !!

2024-10-09T19:29:37,656           ********************************************************************************
2024-10-09T19:29:37,656           ############################
2024-10-09T19:29:37,656           # Package would be ignored #
2024-10-09T19:29:37,656           ############################
2024-10-09T19:29:37,656           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-10-09T19:29:37,656           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,656           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,657           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-10-09T19:29:37,657           to the `packages` configuration field.

2024-10-09T19:29:37,657           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,657           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,657           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,657           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,658           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,658           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-10-09T19:29:37,658           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-10-09T19:29:37,658           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,658           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,658           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,658           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,659           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,659           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,659                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,659                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,659                 directory, all directories are treated like packages.
2024-10-09T19:29:37,659           ********************************************************************************

2024-10-09T19:29:37,659   !!
2024-10-09T19:29:37,660     check.warn(importable)
2024-10-09T19:29:37,660   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-10-09T19:29:37,660   !!

2024-10-09T19:29:37,660           ********************************************************************************
2024-10-09T19:29:37,660           ############################
2024-10-09T19:29:37,660           # Package would be ignored #
2024-10-09T19:29:37,660           ############################
2024-10-09T19:29:37,660           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-10-09T19:29:37,661           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,661           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,661           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-10-09T19:29:37,661           to the `packages` configuration field.

2024-10-09T19:29:37,661           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,661           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,661           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,662           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,662           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,662           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-10-09T19:29:37,662           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-10-09T19:29:37,662           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,662           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,662           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,663           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,663           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,663           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,663                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,663                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,663                 directory, all directories are treated like packages.
2024-10-09T19:29:37,663           ********************************************************************************

2024-10-09T19:29:37,664   !!
2024-10-09T19:29:37,664     check.warn(importable)
2024-10-09T19:29:37,664   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-10-09T19:29:37,664   !!

2024-10-09T19:29:37,664           ********************************************************************************
2024-10-09T19:29:37,664           ############################
2024-10-09T19:29:37,664           # Package would be ignored #
2024-10-09T19:29:37,665           ############################
2024-10-09T19:29:37,665           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-10-09T19:29:37,665           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,665           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,665           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-10-09T19:29:37,665           to the `packages` configuration field.

2024-10-09T19:29:37,665           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,665           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,666           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,666           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,666           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,666           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-10-09T19:29:37,666           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-10-09T19:29:37,667           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,667           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,667           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,667           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,667           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,667           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,668                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,668                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,668                 directory, all directories are treated like packages.
2024-10-09T19:29:37,668           ********************************************************************************

2024-10-09T19:29:37,668   !!
2024-10-09T19:29:37,668     check.warn(importable)
2024-10-09T19:29:37,668   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-10-09T19:29:37,668   !!

2024-10-09T19:29:37,669           ********************************************************************************
2024-10-09T19:29:37,669           ############################
2024-10-09T19:29:37,669           # Package would be ignored #
2024-10-09T19:29:37,669           ############################
2024-10-09T19:29:37,669           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-10-09T19:29:37,669           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,669           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,670           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-10-09T19:29:37,670           to the `packages` configuration field.

2024-10-09T19:29:37,670           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,670           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,670           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,670           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,671           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,671           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-10-09T19:29:37,671           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-10-09T19:29:37,671           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,671           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,671           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,671           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,672           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,672           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,672                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,672                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,672                 directory, all directories are treated like packages.
2024-10-09T19:29:37,672           ********************************************************************************

2024-10-09T19:29:37,673   !!
2024-10-09T19:29:37,673     check.warn(importable)
2024-10-09T19:29:37,673   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-10-09T19:29:37,673   !!

2024-10-09T19:29:37,673           ********************************************************************************
2024-10-09T19:29:37,673           ############################
2024-10-09T19:29:37,673           # Package would be ignored #
2024-10-09T19:29:37,673           ############################
2024-10-09T19:29:37,673           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-10-09T19:29:37,674           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,674           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,674           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-10-09T19:29:37,674           to the `packages` configuration field.

2024-10-09T19:29:37,674           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,674           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,674           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,675           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,675           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,675           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-10-09T19:29:37,675           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-10-09T19:29:37,675           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,675           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,675           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,676           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,676           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,676           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,676                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,676                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,676                 directory, all directories are treated like packages.
2024-10-09T19:29:37,677           ********************************************************************************

2024-10-09T19:29:37,677   !!
2024-10-09T19:29:37,677     check.warn(importable)
2024-10-09T19:29:37,677   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-10-09T19:29:37,677   !!

2024-10-09T19:29:37,677           ********************************************************************************
2024-10-09T19:29:37,677           ############################
2024-10-09T19:29:37,677           # Package would be ignored #
2024-10-09T19:29:37,678           ############################
2024-10-09T19:29:37,678           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-10-09T19:29:37,678           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,678           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,678           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-10-09T19:29:37,678           to the `packages` configuration field.

2024-10-09T19:29:37,678           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,679           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,679           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,679           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,679           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,679           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-10-09T19:29:37,679           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-10-09T19:29:37,679           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,680           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,680           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,680           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,680           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,680           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,680                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,681                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,681                 directory, all directories are treated like packages.
2024-10-09T19:29:37,681           ********************************************************************************

2024-10-09T19:29:37,681   !!
2024-10-09T19:29:37,681     check.warn(importable)
2024-10-09T19:29:37,681   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-10-09T19:29:37,681   !!

2024-10-09T19:29:37,681           ********************************************************************************
2024-10-09T19:29:37,682           ############################
2024-10-09T19:29:37,682           # Package would be ignored #
2024-10-09T19:29:37,682           ############################
2024-10-09T19:29:37,682           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-10-09T19:29:37,682           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,682           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,682           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-10-09T19:29:37,683           to the `packages` configuration field.

2024-10-09T19:29:37,683           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,683           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,683           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,683           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,683           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,684           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-10-09T19:29:37,684           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-10-09T19:29:37,684           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,684           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,684           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,684           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,684           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,685           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,685                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,685                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,685                 directory, all directories are treated like packages.
2024-10-09T19:29:37,685           ********************************************************************************

2024-10-09T19:29:37,685   !!
2024-10-09T19:29:37,686     check.warn(importable)
2024-10-09T19:29:37,686   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-10-09T19:29:37,686   !!

2024-10-09T19:29:37,686           ********************************************************************************
2024-10-09T19:29:37,686           ############################
2024-10-09T19:29:37,686           # Package would be ignored #
2024-10-09T19:29:37,686           ############################
2024-10-09T19:29:37,686           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-10-09T19:29:37,686           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,687           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,687           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-10-09T19:29:37,687           to the `packages` configuration field.

2024-10-09T19:29:37,687           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,687           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,687           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,687           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,688           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,688           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-10-09T19:29:37,688           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-10-09T19:29:37,688           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,688           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,688           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,689           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,689           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,689           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,689                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,689                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,689                 directory, all directories are treated like packages.
2024-10-09T19:29:37,689           ********************************************************************************

2024-10-09T19:29:37,690   !!
2024-10-09T19:29:37,690     check.warn(importable)
2024-10-09T19:29:37,690   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-10-09T19:29:37,690   !!

2024-10-09T19:29:37,690           ********************************************************************************
2024-10-09T19:29:37,690           ############################
2024-10-09T19:29:37,690           # Package would be ignored #
2024-10-09T19:29:37,690           ############################
2024-10-09T19:29:37,691           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-10-09T19:29:37,691           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,691           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,691           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-10-09T19:29:37,691           to the `packages` configuration field.

2024-10-09T19:29:37,691           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,691           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,692           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,692           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,692           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,692           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-10-09T19:29:37,692           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-10-09T19:29:37,692           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,692           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,693           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,693           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,693           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,693           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,693                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,693                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,694                 directory, all directories are treated like packages.
2024-10-09T19:29:37,694           ********************************************************************************

2024-10-09T19:29:37,694   !!
2024-10-09T19:29:37,694     check.warn(importable)
2024-10-09T19:29:37,694   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-10-09T19:29:37,694   !!

2024-10-09T19:29:37,694           ********************************************************************************
2024-10-09T19:29:37,694           ############################
2024-10-09T19:29:37,695           # Package would be ignored #
2024-10-09T19:29:37,695           ############################
2024-10-09T19:29:37,695           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-10-09T19:29:37,695           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,695           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,695           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-10-09T19:29:37,695           to the `packages` configuration field.

2024-10-09T19:29:37,696           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,696           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,696           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,696           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,696           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,696           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-10-09T19:29:37,696           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-10-09T19:29:37,697           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,697           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,697           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,697           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,697           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,697           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,698                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,698                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,698                 directory, all directories are treated like packages.
2024-10-09T19:29:37,698           ********************************************************************************

2024-10-09T19:29:37,698   !!
2024-10-09T19:29:37,698     check.warn(importable)
2024-10-09T19:29:37,698   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2024-10-09T19:29:37,699   !!

2024-10-09T19:29:37,699           ********************************************************************************
2024-10-09T19:29:37,699           ############################
2024-10-09T19:29:37,699           # Package would be ignored #
2024-10-09T19:29:37,699           ############################
2024-10-09T19:29:37,699           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2024-10-09T19:29:37,699           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,700           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,700           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2024-10-09T19:29:37,700           to the `packages` configuration field.

2024-10-09T19:29:37,700           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,700           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,700           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,700           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,701           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,701           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2024-10-09T19:29:37,701           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2024-10-09T19:29:37,701           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,701           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,701           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,701           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,702           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,702           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,702                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,702                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,702                 directory, all directories are treated like packages.
2024-10-09T19:29:37,702           ********************************************************************************

2024-10-09T19:29:37,703   !!
2024-10-09T19:29:37,703     check.warn(importable)
2024-10-09T19:29:37,703   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-10-09T19:29:37,703   !!

2024-10-09T19:29:37,703           ********************************************************************************
2024-10-09T19:29:37,703           ############################
2024-10-09T19:29:37,703           # Package would be ignored #
2024-10-09T19:29:37,703           ############################
2024-10-09T19:29:37,704           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-10-09T19:29:37,704           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,704           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,704           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-10-09T19:29:37,704           to the `packages` configuration field.

2024-10-09T19:29:37,704           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,704           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,705           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,705           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,705           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,705           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-10-09T19:29:37,705           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-10-09T19:29:37,705           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,705           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,706           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,706           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,706           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,706           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,706                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,707                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,707                 directory, all directories are treated like packages.
2024-10-09T19:29:37,707           ********************************************************************************

2024-10-09T19:29:37,707   !!
2024-10-09T19:29:37,707     check.warn(importable)
2024-10-09T19:29:37,707   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-10-09T19:29:37,707   !!

2024-10-09T19:29:37,708           ********************************************************************************
2024-10-09T19:29:37,708           ############################
2024-10-09T19:29:37,708           # Package would be ignored #
2024-10-09T19:29:37,708           ############################
2024-10-09T19:29:37,708           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-10-09T19:29:37,708           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,709           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,709           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-10-09T19:29:37,709           to the `packages` configuration field.

2024-10-09T19:29:37,709           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,709           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,709           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,710           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,710           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,710           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-10-09T19:29:37,710           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-10-09T19:29:37,710           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,710           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,711           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,711           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,711           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,711           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,712                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,712                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,712                 directory, all directories are treated like packages.
2024-10-09T19:29:37,712           ********************************************************************************

2024-10-09T19:29:37,712   !!
2024-10-09T19:29:37,712     check.warn(importable)
2024-10-09T19:29:37,712   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-10-09T19:29:37,712   !!

2024-10-09T19:29:37,713           ********************************************************************************
2024-10-09T19:29:37,713           ############################
2024-10-09T19:29:37,713           # Package would be ignored #
2024-10-09T19:29:37,713           ############################
2024-10-09T19:29:37,713           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-10-09T19:29:37,713           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,714           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,714           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-10-09T19:29:37,714           to the `packages` configuration field.

2024-10-09T19:29:37,714           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,714           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,714           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,715           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,715           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,715           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-10-09T19:29:37,715           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-10-09T19:29:37,715           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,715           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,716           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,716           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,716           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,716           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,717                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,717                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,717                 directory, all directories are treated like packages.
2024-10-09T19:29:37,717           ********************************************************************************

2024-10-09T19:29:37,717   !!
2024-10-09T19:29:37,717     check.warn(importable)
2024-10-09T19:29:37,717   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-10-09T19:29:37,717   !!

2024-10-09T19:29:37,718           ********************************************************************************
2024-10-09T19:29:37,718           ############################
2024-10-09T19:29:37,718           # Package would be ignored #
2024-10-09T19:29:37,718           ############################
2024-10-09T19:29:37,718           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-10-09T19:29:37,718           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,718           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,718           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-10-09T19:29:37,719           to the `packages` configuration field.

2024-10-09T19:29:37,719           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,719           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,719           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,719           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,719           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,720           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-10-09T19:29:37,720           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-10-09T19:29:37,720           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,720           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,720           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,720           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,720           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,721           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,721                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,721                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,721                 directory, all directories are treated like packages.
2024-10-09T19:29:37,721           ********************************************************************************

2024-10-09T19:29:37,721   !!
2024-10-09T19:29:37,722     check.warn(importable)
2024-10-09T19:29:37,722   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-10-09T19:29:37,722   !!

2024-10-09T19:29:37,722           ********************************************************************************
2024-10-09T19:29:37,722           ############################
2024-10-09T19:29:37,722           # Package would be ignored #
2024-10-09T19:29:37,722           ############################
2024-10-09T19:29:37,722           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-10-09T19:29:37,723           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,723           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,723           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-10-09T19:29:37,723           to the `packages` configuration field.

2024-10-09T19:29:37,723           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,723           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,723           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,724           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,724           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,724           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-10-09T19:29:37,724           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-10-09T19:29:37,724           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,724           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,724           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,725           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,725           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,725           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,725                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,725                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,725                 directory, all directories are treated like packages.
2024-10-09T19:29:37,726           ********************************************************************************

2024-10-09T19:29:37,726   !!
2024-10-09T19:29:37,726     check.warn(importable)
2024-10-09T19:29:37,726   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-10-09T19:29:37,726   !!

2024-10-09T19:29:37,726           ********************************************************************************
2024-10-09T19:29:37,726           ############################
2024-10-09T19:29:37,727           # Package would be ignored #
2024-10-09T19:29:37,727           ############################
2024-10-09T19:29:37,727           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-10-09T19:29:37,727           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,727           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,727           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-10-09T19:29:37,727           to the `packages` configuration field.

2024-10-09T19:29:37,728           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,728           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,728           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,728           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,728           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,728           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-10-09T19:29:37,729           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-10-09T19:29:37,729           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,729           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,729           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,729           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,729           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,730           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,730                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,730                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,730                 directory, all directories are treated like packages.
2024-10-09T19:29:37,730           ********************************************************************************

2024-10-09T19:29:37,731   !!
2024-10-09T19:29:37,731     check.warn(importable)
2024-10-09T19:29:37,731   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-10-09T19:29:37,731   !!

2024-10-09T19:29:37,731           ********************************************************************************
2024-10-09T19:29:37,731           ############################
2024-10-09T19:29:37,731           # Package would be ignored #
2024-10-09T19:29:37,732           ############################
2024-10-09T19:29:37,732           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-10-09T19:29:37,732           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,732           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,732           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-10-09T19:29:37,732           to the `packages` configuration field.

2024-10-09T19:29:37,732           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,733           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,733           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,733           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,733           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,733           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-10-09T19:29:37,734           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-10-09T19:29:37,734           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,734           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,734           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,734           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,735           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,735           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,735                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,735                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,735                 directory, all directories are treated like packages.
2024-10-09T19:29:37,735           ********************************************************************************

2024-10-09T19:29:37,736   !!
2024-10-09T19:29:37,736     check.warn(importable)
2024-10-09T19:29:37,736   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-10-09T19:29:37,736   !!

2024-10-09T19:29:37,736           ********************************************************************************
2024-10-09T19:29:37,736           ############################
2024-10-09T19:29:37,736           # Package would be ignored #
2024-10-09T19:29:37,737           ############################
2024-10-09T19:29:37,737           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-10-09T19:29:37,737           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,737           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,737           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-10-09T19:29:37,737           to the `packages` configuration field.

2024-10-09T19:29:37,738           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,738           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,738           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,738           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,738           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,738           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-10-09T19:29:37,738           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-10-09T19:29:37,739           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,739           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,739           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,739           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,739           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,740           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,740                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,740                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,740                 directory, all directories are treated like packages.
2024-10-09T19:29:37,740           ********************************************************************************

2024-10-09T19:29:37,740   !!
2024-10-09T19:29:37,741     check.warn(importable)
2024-10-09T19:29:37,741   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-10-09T19:29:37,741   !!

2024-10-09T19:29:37,741           ********************************************************************************
2024-10-09T19:29:37,741           ############################
2024-10-09T19:29:37,741           # Package would be ignored #
2024-10-09T19:29:37,741           ############################
2024-10-09T19:29:37,742           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-10-09T19:29:37,742           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,742           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,742           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-10-09T19:29:37,742           to the `packages` configuration field.

2024-10-09T19:29:37,742           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,743           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,743           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,743           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,743           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,743           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-10-09T19:29:37,743           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-10-09T19:29:37,744           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,744           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,744           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,744           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,744           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,745           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,745                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,745                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,745                 directory, all directories are treated like packages.
2024-10-09T19:29:37,745           ********************************************************************************

2024-10-09T19:29:37,745   !!
2024-10-09T19:29:37,745     check.warn(importable)
2024-10-09T19:29:37,746   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-10-09T19:29:37,746   !!

2024-10-09T19:29:37,746           ********************************************************************************
2024-10-09T19:29:37,746           ############################
2024-10-09T19:29:37,746           # Package would be ignored #
2024-10-09T19:29:37,746           ############################
2024-10-09T19:29:37,746           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-10-09T19:29:37,747           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,747           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,747           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-10-09T19:29:37,747           to the `packages` configuration field.

2024-10-09T19:29:37,747           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,747           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,747           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,748           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,748           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,748           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-10-09T19:29:37,748           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-10-09T19:29:37,748           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,748           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,749           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,749           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,749           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,749           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,750                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,750                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,750                 directory, all directories are treated like packages.
2024-10-09T19:29:37,750           ********************************************************************************

2024-10-09T19:29:37,750   !!
2024-10-09T19:29:37,750     check.warn(importable)
2024-10-09T19:29:37,750   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-10-09T19:29:37,751   !!

2024-10-09T19:29:37,751           ********************************************************************************
2024-10-09T19:29:37,751           ############################
2024-10-09T19:29:37,751           # Package would be ignored #
2024-10-09T19:29:37,751           ############################
2024-10-09T19:29:37,751           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-10-09T19:29:37,751           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,752           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,752           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-10-09T19:29:37,752           to the `packages` configuration field.

2024-10-09T19:29:37,752           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,752           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,752           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,753           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,753           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,753           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-10-09T19:29:37,753           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-10-09T19:29:37,753           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,754           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,754           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,754           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,754           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,755           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,755                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,755                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,755                 directory, all directories are treated like packages.
2024-10-09T19:29:37,755           ********************************************************************************

2024-10-09T19:29:37,755   !!
2024-10-09T19:29:37,755     check.warn(importable)
2024-10-09T19:29:37,756   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-10-09T19:29:37,756   !!

2024-10-09T19:29:37,756           ********************************************************************************
2024-10-09T19:29:37,756           ############################
2024-10-09T19:29:37,756           # Package would be ignored #
2024-10-09T19:29:37,756           ############################
2024-10-09T19:29:37,756           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-10-09T19:29:37,756           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,757           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,757           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-10-09T19:29:37,757           to the `packages` configuration field.

2024-10-09T19:29:37,757           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,757           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,757           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,758           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,758           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,758           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-10-09T19:29:37,758           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-10-09T19:29:37,758           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,758           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,759           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,759           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,759           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,759           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,760                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,760                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,760                 directory, all directories are treated like packages.
2024-10-09T19:29:37,760           ********************************************************************************

2024-10-09T19:29:37,760   !!
2024-10-09T19:29:37,760     check.warn(importable)
2024-10-09T19:29:37,760   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-10-09T19:29:37,761   !!

2024-10-09T19:29:37,761           ********************************************************************************
2024-10-09T19:29:37,761           ############################
2024-10-09T19:29:37,761           # Package would be ignored #
2024-10-09T19:29:37,761           ############################
2024-10-09T19:29:37,761           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-10-09T19:29:37,761           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,762           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,762           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-10-09T19:29:37,762           to the `packages` configuration field.

2024-10-09T19:29:37,762           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,762           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,762           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,763           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,763           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,763           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-10-09T19:29:37,763           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-10-09T19:29:37,763           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,763           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,764           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,764           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,764           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,764           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,765                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,765                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,765                 directory, all directories are treated like packages.
2024-10-09T19:29:37,765           ********************************************************************************

2024-10-09T19:29:37,765   !!
2024-10-09T19:29:37,765     check.warn(importable)
2024-10-09T19:29:37,765   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-10-09T19:29:37,766   !!

2024-10-09T19:29:37,766           ********************************************************************************
2024-10-09T19:29:37,766           ############################
2024-10-09T19:29:37,766           # Package would be ignored #
2024-10-09T19:29:37,766           ############################
2024-10-09T19:29:37,766           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-10-09T19:29:37,766           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,767           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,767           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-10-09T19:29:37,767           to the `packages` configuration field.

2024-10-09T19:29:37,767           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,767           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,767           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,768           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,768           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,768           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-10-09T19:29:37,768           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-10-09T19:29:37,768           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,768           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,769           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,769           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,769           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,769           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,770                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,770                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,770                 directory, all directories are treated like packages.
2024-10-09T19:29:37,770           ********************************************************************************

2024-10-09T19:29:37,770   !!
2024-10-09T19:29:37,770     check.warn(importable)
2024-10-09T19:29:37,770   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.aio' is absent from the `packages` configuration.
2024-10-09T19:29:37,771   !!

2024-10-09T19:29:37,771           ********************************************************************************
2024-10-09T19:29:37,771           ############################
2024-10-09T19:29:37,771           # Package would be ignored #
2024-10-09T19:29:37,771           ############################
2024-10-09T19:29:37,771           Python recognizes 'deepspeed.ops.csrc.xpu.aio' as an importable package[^1],
2024-10-09T19:29:37,771           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,772           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,772           package, please make sure that 'deepspeed.ops.csrc.xpu.aio' is explicitly added
2024-10-09T19:29:37,772           to the `packages` configuration field.

2024-10-09T19:29:37,772           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,772           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,773           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,773           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,773           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,773           If you don't want 'deepspeed.ops.csrc.xpu.aio' to be distributed and are
2024-10-09T19:29:37,773           already explicitly excluding 'deepspeed.ops.csrc.xpu.aio' via
2024-10-09T19:29:37,773           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,774           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,774           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,774           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,774           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,775           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,775                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,775                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,775                 directory, all directories are treated like packages.
2024-10-09T19:29:37,775           ********************************************************************************

2024-10-09T19:29:37,775   !!
2024-10-09T19:29:37,775     check.warn(importable)
2024-10-09T19:29:37,776   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-10-09T19:29:37,776   !!

2024-10-09T19:29:37,776           ********************************************************************************
2024-10-09T19:29:37,776           ############################
2024-10-09T19:29:37,776           # Package would be ignored #
2024-10-09T19:29:37,776           ############################
2024-10-09T19:29:37,776           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-10-09T19:29:37,777           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,777           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,777           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-10-09T19:29:37,777           to the `packages` configuration field.

2024-10-09T19:29:37,777           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,777           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,778           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,778           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,778           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,778           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-10-09T19:29:37,778           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-10-09T19:29:37,778           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,779           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,779           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,779           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,779           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,780           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,780                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,780                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,780                 directory, all directories are treated like packages.
2024-10-09T19:29:37,780           ********************************************************************************

2024-10-09T19:29:37,780   !!
2024-10-09T19:29:37,780     check.warn(importable)
2024-10-09T19:29:37,781   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-10-09T19:29:37,781   !!

2024-10-09T19:29:37,781           ********************************************************************************
2024-10-09T19:29:37,781           ############################
2024-10-09T19:29:37,781           # Package would be ignored #
2024-10-09T19:29:37,781           ############################
2024-10-09T19:29:37,781           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-10-09T19:29:37,782           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,782           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,782           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-10-09T19:29:37,782           to the `packages` configuration field.

2024-10-09T19:29:37,782           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,782           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,783           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,783           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,783           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,783           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-10-09T19:29:37,783           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-10-09T19:29:37,784           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,784           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,784           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,784           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,784           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,785           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,785                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,785                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,785                 directory, all directories are treated like packages.
2024-10-09T19:29:37,785           ********************************************************************************

2024-10-09T19:29:37,785   !!
2024-10-09T19:29:37,786     check.warn(importable)
2024-10-09T19:29:37,786   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-10-09T19:29:37,786   !!

2024-10-09T19:29:37,786           ********************************************************************************
2024-10-09T19:29:37,786           ############################
2024-10-09T19:29:37,786           # Package would be ignored #
2024-10-09T19:29:37,786           ############################
2024-10-09T19:29:37,787           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-10-09T19:29:37,787           but it is absent from setuptools' `packages` configuration.

2024-10-09T19:29:37,787           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-09T19:29:37,787           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-10-09T19:29:37,787           to the `packages` configuration field.

2024-10-09T19:29:37,787           Alternatively, you can also rely on setuptools' discovery methods
2024-10-09T19:29:37,787           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-09T19:29:37,788           instead of `find_packages(...)`/`find:`).

2024-10-09T19:29:37,788           You can read more about "package discovery" on setuptools documentation page:

2024-10-09T19:29:37,788           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-09T19:29:37,788           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-10-09T19:29:37,788           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-10-09T19:29:37,789           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-09T19:29:37,789           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-09T19:29:37,789           combination with a more fine grained `package-data` configuration.

2024-10-09T19:29:37,789           You can read more about "package data files" on setuptools documentation page:

2024-10-09T19:29:37,789           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-09T19:29:37,790           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-09T19:29:37,790                 even if it does not contain any `.py` files.
2024-10-09T19:29:37,790                 On the other hand, currently there is no concept of package data
2024-10-09T19:29:37,790                 directory, all directories are treated like packages.
2024-10-09T19:29:37,790           ********************************************************************************

2024-10-09T19:29:37,790   !!
2024-10-09T19:29:37,791     check.warn(importable)
2024-10-09T19:29:37,791   creating build/lib/deepspeed/autotuning/config_templates
2024-10-09T19:29:37,791   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-10-09T19:29:37,791   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-10-09T19:29:37,791   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-10-09T19:29:37,792   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-10-09T19:29:37,794   creating build/lib/deepspeed/ops/csrc
2024-10-09T19:29:37,794   creating build/lib/deepspeed/ops/csrc/adagrad
2024-10-09T19:29:37,795   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-10-09T19:29:37,798   creating build/lib/deepspeed/ops/csrc/adam
2024-10-09T19:29:37,799   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-10-09T19:29:37,801   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-10-09T19:29:37,803   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-10-09T19:29:37,805   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-10-09T19:29:37,807   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-10-09T19:29:37,810   creating build/lib/deepspeed/ops/csrc/aio
2024-10-09T19:29:37,810   creating build/lib/deepspeed/ops/csrc/aio/common
2024-10-09T19:29:37,811   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-09T19:29:37,814   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-09T19:29:37,816   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-09T19:29:37,818   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-09T19:29:37,820   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-09T19:29:37,822   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-09T19:29:37,824   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,825   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,827   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,829   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,831   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,833   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,835   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,837   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,839   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,841   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,843   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,845   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,847   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,849   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,851   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,853   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,855   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,857   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:37,859   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-10-09T19:29:37,860   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-10-09T19:29:37,862   creating build/lib/deepspeed/ops/csrc/cpu
2024-10-09T19:29:37,863   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-10-09T19:29:37,864   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-10-09T19:29:37,866   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:37,867   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:37,869   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:37,872   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:37,874   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:37,876   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-10-09T19:29:37,877   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-10-09T19:29:37,879   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-10-09T19:29:37,879   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:37,880   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:37,882   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:37,885   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:37,887   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:37,890   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:37,893   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:37,897   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:37,897   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:37,900   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:37,902   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:37,905   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:37,907   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:37,908   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:37,910   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:37,913   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:37,915   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:37,918   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:37,921   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:37,923   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:37,927   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:37,928   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:37,931   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:37,933   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:37,937   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:37,940   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:37,943   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:37,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:37,947   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-09T19:29:37,948   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-09T19:29:37,951   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-09T19:29:37,953   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-10-09T19:29:37,954   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-10-09T19:29:37,956   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-10-09T19:29:37,959   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-10-09T19:29:37,959   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-10-09T19:29:37,961   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-10-09T19:29:37,964   creating build/lib/deepspeed/ops/csrc/gds
2024-10-09T19:29:37,964   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:37,965   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:37,967   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:37,969   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:37,972   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:37,974   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:37,976   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:37,978   creating build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,979   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,981   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,983   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,985   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,987   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,989   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,992   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,994   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,996   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:37,998   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,001   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,003   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,005   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,007   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,009   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,011   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,013   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,015   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,017   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,019   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,022   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,024   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,026   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,029   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,031   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,033   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,036   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,038   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,040   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-09T19:29:38,042   creating build/lib/deepspeed/ops/csrc/lamb
2024-10-09T19:29:38,043   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-10-09T19:29:38,045   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-10-09T19:29:38,048   creating build/lib/deepspeed/ops/csrc/lion
2024-10-09T19:29:38,049   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-10-09T19:29:38,051   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-10-09T19:29:38,053   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-10-09T19:29:38,055   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-10-09T19:29:38,057   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-10-09T19:29:38,059   creating build/lib/deepspeed/ops/csrc/quantization
2024-10-09T19:29:38,060   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-09T19:29:38,062   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-09T19:29:38,065   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-10-09T19:29:38,068   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-09T19:29:38,070   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-09T19:29:38,073   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-09T19:29:38,075   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-09T19:29:38,078   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:38,079   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:38,081   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:38,084   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:38,086   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:38,088   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-10-09T19:29:38,089   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-10-09T19:29:38,091   creating build/lib/deepspeed/ops/csrc/spatial
2024-10-09T19:29:38,092   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-10-09T19:29:38,093   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-10-09T19:29:38,095   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-10-09T19:29:38,097   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-10-09T19:29:38,098   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-10-09T19:29:38,100   creating build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,101   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,104   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,107   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,110   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,112   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,115   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,118   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,121   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-09T19:29:38,124   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-10-09T19:29:38,124   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,125   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,128   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,130   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,133   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,136   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,138   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,142   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,144   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,147   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,149   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:38,152   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-10-09T19:29:38,153   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-10-09T19:29:38,156   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-10-09T19:29:38,159   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-10-09T19:29:38,161   creating build/lib/deepspeed/ops/csrc/utils
2024-10-09T19:29:38,162   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-10-09T19:29:38,164   creating build/lib/deepspeed/ops/csrc/xpu
2024-10-09T19:29:38,164   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-10-09T19:29:38,166   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-10-09T19:29:38,168   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-10-09T19:29:38,169   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-10-09T19:29:38,171   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-10-09T19:29:38,173   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-10-09T19:29:38,175   creating build/lib/deepspeed/ops/csrc/xpu/aio
2024-10-09T19:29:38,176   copying deepspeed/ops/csrc/xpu/aio/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/xpu/aio
2024-10-09T19:29:38,178   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-10-09T19:29:38,179   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-10-09T19:29:38,181   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:38,182   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:38,184   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:38,186   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:38,189   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:38,191   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:38,194   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-10-09T19:29:38,195   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-10-09T19:29:38,197   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,198   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,200   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,202   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,204   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,207   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,209   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-10-09T19:29:38,210   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-10-09T19:29:38,212   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-10-09T19:29:38,214   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-10-09T19:29:38,215   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-10-09T19:29:38,217   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-10-09T19:29:38,219   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-10-09T19:29:38,221   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-10-09T19:29:38,222   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-10-09T19:29:38,224   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-10-09T19:29:38,226   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-10-09T19:29:38,227   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-10-09T19:29:38,229   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-09T19:29:38,230   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-09T19:29:38,232   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-09T19:29:38,234   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-09T19:29:38,236   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,239   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,241   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,243   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,245   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,246   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,249   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,251   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,253   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,255   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,257   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,260   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,262   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,264   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,266   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:38,269   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:38,271   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,273   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,275   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,277   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,279   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,281   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,284   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,287   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,289   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,291   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,293   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,295   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,297   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,299   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,302   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,303   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,306   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,308   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,309   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,312   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,314   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,315   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,318   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,320   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,322   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,324   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,326   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,329   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,331   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,333   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,336   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,337   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,339   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,341   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,343   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,345   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,347   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,349   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,352   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,354   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,356   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,358   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,359   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:38,361   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:38,363   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,365   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,367   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,369   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,372   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:38,374   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:38,376   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:38,441   running build_scripts
2024-10-09T19:29:38,442   creating build/scripts-3.9
2024-10-09T19:29:38,443   copying and adjusting bin/deepspeed -> build/scripts-3.9
2024-10-09T19:29:38,445   copying and adjusting bin/deepspeed.pt -> build/scripts-3.9
2024-10-09T19:29:38,446   copying and adjusting bin/ds -> build/scripts-3.9
2024-10-09T19:29:38,447   copying bin/ds_ssh -> build/scripts-3.9
2024-10-09T19:29:38,449   copying and adjusting bin/ds_report -> build/scripts-3.9
2024-10-09T19:29:38,451   copying and adjusting bin/ds_bench -> build/scripts-3.9
2024-10-09T19:29:38,452   copying and adjusting bin/dsr -> build/scripts-3.9
2024-10-09T19:29:38,453   copying and adjusting bin/ds_elastic -> build/scripts-3.9
2024-10-09T19:29:38,455   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.9
2024-10-09T19:29:38,456   copying and adjusting bin/ds_io -> build/scripts-3.9
2024-10-09T19:29:38,457   changing mode of build/scripts-3.9/deepspeed from 644 to 755
2024-10-09T19:29:38,458   changing mode of build/scripts-3.9/deepspeed.pt from 644 to 755
2024-10-09T19:29:38,458   changing mode of build/scripts-3.9/ds from 644 to 755
2024-10-09T19:29:38,458   changing mode of build/scripts-3.9/ds_report from 644 to 755
2024-10-09T19:29:38,459   changing mode of build/scripts-3.9/ds_bench from 644 to 755
2024-10-09T19:29:38,459   changing mode of build/scripts-3.9/dsr from 644 to 755
2024-10-09T19:29:38,459   changing mode of build/scripts-3.9/ds_elastic from 644 to 755
2024-10-09T19:29:38,460   changing mode of build/scripts-3.9/ds_nvme_tune from 644 to 755
2024-10-09T19:29:38,460   changing mode of build/scripts-3.9/ds_io from 644 to 755
2024-10-09T19:29:38,486   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-10-09T19:29:38,486   !!

2024-10-09T19:29:38,486           ********************************************************************************
2024-10-09T19:29:38,487           Please avoid running ``setup.py`` directly.
2024-10-09T19:29:38,487           Instead, use pypa/build, pypa/installer or other
2024-10-09T19:29:38,487           standards-based tools.

2024-10-09T19:29:38,487           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-10-09T19:29:38,487           ********************************************************************************

2024-10-09T19:29:38,487   !!
2024-10-09T19:29:38,488     self.initialize_options()
2024-10-09T19:29:38,511   installing to build/bdist.linux-armv7l/wheel
2024-10-09T19:29:38,512   running install
2024-10-09T19:29:38,538   running install_lib
2024-10-09T19:29:38,565   creating build/bdist.linux-armv7l
2024-10-09T19:29:38,566   creating build/bdist.linux-armv7l/wheel
2024-10-09T19:29:38,567   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-10-09T19:29:38,569   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-10-09T19:29:38,570   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-10-09T19:29:38,572   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-10-09T19:29:38,573   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-10-09T19:29:38,575   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-09T19:29:38,577   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-10-09T19:29:38,578   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,580   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,582   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,584   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,586   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,588   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,590   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,592   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,593   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,596   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,597   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,599   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,601   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,603   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,605   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,607   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,609   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,611   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-09T19:29:38,614   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-10-09T19:29:38,615   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-09T19:29:38,617   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-09T19:29:38,618   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-09T19:29:38,621   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-09T19:29:38,622   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-09T19:29:38,624   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-09T19:29:38,626   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-10-09T19:29:38,628   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-10-09T19:29:38,629   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:38,631   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-10-09T19:29:38,633   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-10-09T19:29:38,634   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,635   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,638   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,640   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,641   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,642   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,645   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,647   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,649   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,651   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,653   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,655   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,657   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-09T19:29:38,659   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,661   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,663   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,665   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-09T19:29:38,668   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:38,669   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:38,671   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:38,673   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:38,675   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-09T19:29:38,677   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,678   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,679   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,681   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,683   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,685   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-09T19:29:38,687   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,688   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,690   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,692   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,694   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,696   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,697   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,699   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,701   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-09T19:29:38,703   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,704   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,706   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,707   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,709   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,711   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,713   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,714   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-09T19:29:38,717   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-10-09T19:29:38,718   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-10-09T19:29:38,720   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,721   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,723   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,724   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,726   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,727   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-09T19:29:38,729   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-10-09T19:29:38,731   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-10-09T19:29:38,733   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,734   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,736   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,738   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,740   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,742   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-09T19:29:38,745   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-10-09T19:29:38,746   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-10-09T19:29:38,747   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-10-09T19:29:38,750   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,750   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,753   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,754   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,757   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,759   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,760   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-09T19:29:38,762   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-10-09T19:29:38,763   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-10-09T19:29:38,766   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,766   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,769   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,770   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,772   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,774   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-09T19:29:38,776   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-10-09T19:29:38,777   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-10-09T19:29:38,779   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-09T19:29:38,780   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-09T19:29:38,782   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-09T19:29:38,783   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-09T19:29:38,786   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,787   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,789   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,790   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,793   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,794   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,796   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-09T19:29:38,798   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,799   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,801   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,803   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,805   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,807   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,809   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-09T19:29:38,811   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,812   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,814   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,816   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,817   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,820   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,821   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,823   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,825   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-09T19:29:38,827   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,828   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,830   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,832   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,834   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,835   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,837   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-09T19:29:38,839   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,840   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,842   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,844   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,846   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,848   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,850   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-09T19:29:38,852   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-10-09T19:29:38,854   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-10-09T19:29:38,855   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-10-09T19:29:38,857   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,858   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,860   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,862   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,863   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,866   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,868   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-09T19:29:38,870   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:38,871   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:38,874   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:38,875   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:38,877   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-09T19:29:38,879   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,880   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,882   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,884   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,886   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,888   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,890   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-09T19:29:38,892   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-10-09T19:29:38,893   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:38,894   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:38,896   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:38,898   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:38,900   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-09T19:29:38,902   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:38,903   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:38,905   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:38,907   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:38,909   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-10-09T19:29:38,911   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:38,912   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:38,914   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:38,916   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:38,918   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-10-09T19:29:38,920   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:38,921   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:38,923   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:38,925   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:38,926   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-10-09T19:29:38,929   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:38,929   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:38,931   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:38,933   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:38,935   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-09T19:29:38,937   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-09T19:29:38,939   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-09T19:29:38,942   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:38,942   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:38,944   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:38,946   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:38,948   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-10-09T19:29:38,949   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-09T19:29:38,952   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:38,953   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:38,955   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:38,957   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:38,958   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-10-09T19:29:38,961   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:38,962   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:38,963   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:38,965   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:38,967   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-10-09T19:29:38,969   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-09T19:29:38,971   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:38,972   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:38,974   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:38,976   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:38,977   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-10-09T19:29:38,980   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:38,981   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:38,983   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:38,985   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:38,986   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-10-09T19:29:38,988   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-09T19:29:38,991   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:38,992   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:38,994   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:38,995   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:38,997   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:38,999   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:39,001   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:39,002   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:39,004   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:39,006   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-09T19:29:39,007   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-09T19:29:39,010   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-09T19:29:39,013   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,014   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,016   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,017   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,019   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,022   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,024   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,025   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,027   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,029   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-09T19:29:39,031   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-10-09T19:29:39,032   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-10-09T19:29:39,033   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-10-09T19:29:39,035   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-10-09T19:29:39,037   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-09T19:29:39,039   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-09T19:29:39,041   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-09T19:29:39,043   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-09T19:29:39,045   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-09T19:29:39,047   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-10-09T19:29:39,048   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-10-09T19:29:39,050   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-09T19:29:39,052   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-09T19:29:39,054   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:39,055   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:39,057   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:39,059   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:39,060   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:39,062   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-10-09T19:29:39,063   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-10-09T19:29:39,065   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-10-09T19:29:39,067   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-10-09T19:29:39,068   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-10-09T19:29:39,070   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:39,072   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-10-09T19:29:39,073   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-10-09T19:29:39,075   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-10-09T19:29:39,078   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-10-09T19:29:39,079   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-09T19:29:39,080   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-09T19:29:39,082   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-09T19:29:39,083   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-09T19:29:39,085   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-09T19:29:39,087   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-09T19:29:39,089   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-09T19:29:39,090   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-10-09T19:29:39,093   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,093   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,095   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,097   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,099   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,101   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,103   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,104   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,106   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-09T19:29:39,108   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-10-09T19:29:39,109   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-10-09T19:29:39,110   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-10-09T19:29:39,112   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-10-09T19:29:39,114   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-10-09T19:29:39,116   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-10-09T19:29:39,117   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-10-09T19:29:39,119   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-10-09T19:29:39,121   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-10-09T19:29:39,122   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-10-09T19:29:39,125   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-10-09T19:29:39,127   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-10-09T19:29:39,127   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-10-09T19:29:39,130   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-10-09T19:29:39,132   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-10-09T19:29:39,133   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-10-09T19:29:39,135   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-10-09T19:29:39,138   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-10-09T19:29:39,138   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-10-09T19:29:39,140   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-10-09T19:29:39,142   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-09T19:29:39,143   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-09T19:29:39,145   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-09T19:29:39,146   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-09T19:29:39,148   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-10-09T19:29:39,150   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-10-09T19:29:39,151   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:39,154   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-09T19:29:39,155   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-10-09T19:29:39,158   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-10-09T19:29:39,160   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-10-09T19:29:39,161   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-09T19:29:39,163   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-09T19:29:39,165   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-09T19:29:39,167   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-09T19:29:39,169   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-09T19:29:39,171   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-10-09T19:29:39,174   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-10-09T19:29:39,174   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,177   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,178   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,180   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,182   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,185   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,187   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,189   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,191   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,193   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-10-09T19:29:39,194   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,196   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,198   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,200   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,202   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,204   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,206   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,208   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,210   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,211   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,213   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,215   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,217   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,219   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,221   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,223   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,225   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,227   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,229   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-09T19:29:39,231   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-10-09T19:29:39,232   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-09T19:29:39,234   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-09T19:29:39,237   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-09T19:29:39,238   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-09T19:29:39,240   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-09T19:29:39,242   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-09T19:29:39,243   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-09T19:29:39,245   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,247   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,250   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,252   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-09T19:29:39,255   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-10-09T19:29:39,255   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-09T19:29:39,258   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-09T19:29:39,260   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-09T19:29:39,262   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-09T19:29:39,263   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-09T19:29:39,265   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-09T19:29:39,268   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-10-09T19:29:39,269   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,271   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,273   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,274   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,277   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,278   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,281   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,282   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,284   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-09T19:29:39,286   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-10-09T19:29:39,287   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-09T19:29:39,290   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-09T19:29:39,293   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-10-09T19:29:39,293   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-10-09T19:29:39,295   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-10-09T19:29:39,297   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-10-09T19:29:39,298   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-10-09T19:29:39,300   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-09T19:29:39,302   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-09T19:29:39,305   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-09T19:29:39,306   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-09T19:29:39,309   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-10-09T19:29:39,309   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-09T19:29:39,311   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-09T19:29:39,313   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-09T19:29:39,315   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-09T19:29:39,316   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-09T19:29:39,318   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-09T19:29:39,320   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-10-09T19:29:39,321   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-10-09T19:29:39,322   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-10-09T19:29:39,325   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-10-09T19:29:39,326   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-10-09T19:29:39,328   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-10-09T19:29:39,330   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-10-09T19:29:39,331   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-10-09T19:29:39,332   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-10-09T19:29:39,334   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-10-09T19:29:39,335   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,337   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,339   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,341   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,342   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,344   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,346   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,347   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,349   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,350   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-09T19:29:39,353   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-10-09T19:29:39,353   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-10-09T19:29:39,356   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-10-09T19:29:39,357   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-10-09T19:29:39,359   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-10-09T19:29:39,360   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-09T19:29:39,362   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-09T19:29:39,364   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-09T19:29:39,366   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-09T19:29:39,368   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-09T19:29:39,369   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-09T19:29:39,372   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-09T19:29:39,374   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-10-09T19:29:39,375   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-09T19:29:39,378   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-09T19:29:39,381   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-09T19:29:39,382   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-09T19:29:39,384   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-09T19:29:39,386   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-09T19:29:39,389   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-10-09T19:29:39,390   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,392   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,394   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,397   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,399   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,402   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,404   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,406   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,409   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,410   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-09T19:29:39,413   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-10-09T19:29:39,414   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-10-09T19:29:39,415   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-09T19:29:39,418   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-09T19:29:39,421   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-10-09T19:29:39,422   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,424   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,426   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,428   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,430   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,432   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,434   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,436   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,438   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,440   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-09T19:29:39,443   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-10-09T19:29:39,444   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-10-09T19:29:39,445   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-10-09T19:29:39,447   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-10-09T19:29:39,449   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-10-09T19:29:39,451   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-10-09T19:29:39,453   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-10-09T19:29:39,454   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-10-09T19:29:39,456   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-10-09T19:29:39,458   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-10-09T19:29:39,459   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-09T19:29:39,461   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-09T19:29:39,463   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-09T19:29:39,464   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-09T19:29:39,466   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-09T19:29:39,469   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-10-09T19:29:39,470   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-10-09T19:29:39,471   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-10-09T19:29:39,474   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-10-09T19:29:39,474   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-09T19:29:39,476   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-09T19:29:39,478   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-09T19:29:39,481   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-09T19:29:39,483   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-09T19:29:39,485   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-09T19:29:39,487   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,488   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,490   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,491   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,493   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,495   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,497   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,499   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,501   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,502   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,504   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,506   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,508   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,510   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,512   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,513   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,515   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,517   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-09T19:29:39,519   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-10-09T19:29:39,520   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-10-09T19:29:39,522   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2024-10-09T19:29:39,523   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:39,525   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:39,527   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:39,529   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:39,531   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:39,533   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:39,535   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-09T19:29:39,537   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-10-09T19:29:39,538   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-10-09T19:29:39,540   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-10-09T19:29:39,542   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-10-09T19:29:39,542   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-10-09T19:29:39,545   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:39,546   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:39,548   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:39,550   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:39,553   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-10-09T19:29:39,555   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-10-09T19:29:39,557   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-10-09T19:29:39,559   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-10-09T19:29:39,560   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-09T19:29:39,562   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-09T19:29:39,564   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-09T19:29:39,566   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-09T19:29:39,567   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-09T19:29:39,570   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-10-09T19:29:39,571   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-10-09T19:29:39,573   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-10-09T19:29:39,576   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-10-09T19:29:39,577   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:39,578   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:39,579   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:39,582   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:39,584   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:39,589   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:39,591   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:39,594   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:39,596   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-09T19:29:39,598   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:39,600   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:39,603   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-09T19:29:39,604   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-09T19:29:39,606   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-09T19:29:39,609   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:39,610   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:39,613   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:39,615   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:39,617   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-09T19:29:39,620   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:39,622   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:39,625   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:39,628   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:39,629   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:39,631   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:39,634   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:39,638   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:39,640   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:39,642   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:39,645   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-09T19:29:39,650   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-09T19:29:39,655   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-10-09T19:29:39,656   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,658   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,660   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,662   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,664   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,665   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,668   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,670   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,672   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,673   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,675   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,677   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,679   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,682   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,684   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,686   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,688   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,690   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,692   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,694   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,696   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,698   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,700   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,702   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,704   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,706   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,709   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,711   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,713   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-09T19:29:39,717   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-10-09T19:29:39,718   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-10-09T19:29:39,719   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-10-09T19:29:39,721   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-10-09T19:29:39,724   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-10-09T19:29:39,725   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-10-09T19:29:39,727   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-10-09T19:29:39,728   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-10-09T19:29:39,730   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-10-09T19:29:39,731   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-10-09T19:29:39,734   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-10-09T19:29:39,735   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-10-09T19:29:39,737   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-10-09T19:29:39,739   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-10-09T19:29:39,742   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:39,743   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:39,745   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:39,748   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:39,750   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-10-09T19:29:39,753   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-10-09T19:29:39,754   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-09T19:29:39,756   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-09T19:29:39,758   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-09T19:29:39,761   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-09T19:29:39,763   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-09T19:29:39,765   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-09T19:29:39,767   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-09T19:29:39,770   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-10-09T19:29:39,772   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-10-09T19:29:39,773   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-10-09T19:29:39,776   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-10-09T19:29:39,777   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-10-09T19:29:39,780   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-10-09T19:29:39,782   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-10-09T19:29:39,785   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/aio
2024-10-09T19:29:39,786   copying build/lib/deepspeed/ops/csrc/xpu/aio/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/aio
2024-10-09T19:29:39,788   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-10-09T19:29:39,789   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-10-09T19:29:39,791   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:39,792   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:39,794   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:39,796   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:39,798   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:39,800   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-09T19:29:39,803   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-10-09T19:29:39,803   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-10-09T19:29:39,806   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,807   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,810   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,814   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-10-09T19:29:39,815   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,816   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,820   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,823   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,825   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,827   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,830   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,832   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,835   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,838   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,839   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-09T19:29:39,845   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-10-09T19:29:39,846   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-10-09T19:29:39,848   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-10-09T19:29:39,850   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-10-09T19:29:39,853   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,857   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,861   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,864   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,867   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,870   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-09T19:29:39,873   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2024-10-09T19:29:39,874   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2024-10-09T19:29:39,877   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-10-09T19:29:39,877   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-09T19:29:39,881   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-09T19:29:39,883   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-09T19:29:39,886   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-09T19:29:39,887   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-09T19:29:39,890   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:39,891   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:39,893   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:39,895   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:39,897   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-10-09T19:29:39,899   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-09T19:29:39,901   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-09T19:29:39,904   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-10-09T19:29:39,906   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-10-09T19:29:39,907   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-10-09T19:29:39,910   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-10-09T19:29:39,910   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-10-09T19:29:39,913   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-10-09T19:29:39,914   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-10-09T19:29:39,916   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-10-09T19:29:39,919   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-10-09T19:29:39,919   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-10-09T19:29:39,922   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-10-09T19:29:39,924   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-10-09T19:29:39,924   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-10-09T19:29:39,927   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-10-09T19:29:39,928   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-10-09T19:29:39,930   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-10-09T19:29:39,931   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-10-09T19:29:39,933   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-10-09T19:29:39,935   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-10-09T19:29:39,936   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-10-09T19:29:39,938   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-10-09T19:29:39,940   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-10-09T19:29:39,943   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-10-09T19:29:39,943   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-10-09T19:29:39,945   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-10-09T19:29:39,948   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-10-09T19:29:39,949   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,950   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,952   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,954   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,956   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,957   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,959   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,961   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-10-09T19:29:39,962   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-09T19:29:39,964   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-09T19:29:39,966   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-09T19:29:39,967   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-09T19:29:39,969   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-09T19:29:39,971   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-09T19:29:39,972   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,974   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,976   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,977   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,979   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,981   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:39,983   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,984   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,986   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,988   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,990   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,992   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,994   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,995   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,997   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:39,999   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-09T19:29:40,001   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-10-09T19:29:40,002   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-09T19:29:40,003   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-09T19:29:40,005   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-09T19:29:40,007   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-09T19:29:40,009   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-09T19:29:40,010   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-09T19:29:40,012   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,014   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,015   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,017   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,019   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,021   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,023   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,025   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,027   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,028   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,030   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,032   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,033   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,035   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,037   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,039   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,040   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,042   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,044   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-09T19:29:40,046   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,047   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,049   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-09T19:29:40,051   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2024-10-09T19:29:40,052   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-09T19:29:40,054   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-09T19:29:40,056   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-09T19:29:40,057   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-09T19:29:40,059   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-09T19:29:40,061   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-09T19:29:40,063   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-10-09T19:29:40,064   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-10-09T19:29:40,067   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-10-09T19:29:40,068   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,070   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,072   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,074   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,077   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,078   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,080   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,082   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,083   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,086   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,088   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,090   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,092   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,094   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,096   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-09T19:29:40,098   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,101   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,103   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,105   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,107   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,108   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-09T19:29:40,111   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,112   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,114   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,116   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,118   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,119   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,121   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,123   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,125   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,127   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,129   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,130   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,133   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,134   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,136   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,138   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,140   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,142   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,143   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,145   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,147   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,149   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,150   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,152   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-09T19:29:40,154   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-10-09T19:29:40,156   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-10-09T19:29:40,157   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-09T19:29:40,159   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-09T19:29:40,161   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-09T19:29:40,163   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-09T19:29:40,165   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-09T19:29:40,168   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-09T19:29:40,170   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-09T19:29:40,172   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-09T19:29:40,175   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2024-10-09T19:29:40,176   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,178   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,180   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,182   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,183   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,185   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,187   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,189   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,190   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,192   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,194   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,196   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-09T19:29:40,198   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-10-09T19:29:40,199   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-09T19:29:40,201   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-09T19:29:40,203   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-09T19:29:40,205   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-09T19:29:40,206   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-09T19:29:40,208   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-09T19:29:40,210   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-09T19:29:40,212   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-09T19:29:40,214   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-10-09T19:29:40,216   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-10-09T19:29:40,217   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-10-09T19:29:40,220   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-10-09T19:29:40,221   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-10-09T19:29:40,223   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-10-09T19:29:40,225   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-10-09T19:29:40,227   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-10-09T19:29:40,228   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,230   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,232   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,235   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-10-09T19:29:40,236   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-10-09T19:29:40,238   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-10-09T19:29:40,239   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-10-09T19:29:40,242   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,244   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,247   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-10-09T19:29:40,248   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-09T19:29:40,250   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-09T19:29:40,253   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-09T19:29:40,255   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-09T19:29:40,257   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-09T19:29:40,258   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-09T19:29:40,260   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,263   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,265   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,268   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,271   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-10-09T19:29:40,271   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-10-09T19:29:40,274   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-10-09T19:29:40,275   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-10-09T19:29:40,278   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-10-09T19:29:40,280   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-10-09T19:29:40,282   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-10-09T19:29:40,284   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-10-09T19:29:40,286   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-10-09T19:29:40,288   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-10-09T19:29:40,291   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:40,292   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:40,294   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:40,296   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:40,298   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-10-09T19:29:40,300   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-10-09T19:29:40,301   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-09T19:29:40,303   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-09T19:29:40,306   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-09T19:29:40,309   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-09T19:29:40,310   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-09T19:29:40,313   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-09T19:29:40,315   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,320   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,322   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,324   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,326   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,329   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-10-09T19:29:40,330   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:40,331   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:40,335   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:40,338   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:40,340   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:40,342   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-09T19:29:40,344   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-10-09T19:29:40,347   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-10-09T19:29:40,349   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-10-09T19:29:40,352   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:40,353   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:40,355   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:40,357   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:40,359   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:40,361   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-09T19:29:40,363   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-10-09T19:29:40,366   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,367   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,370   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,373   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,375   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,377   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,380   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,382   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,384   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,386   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-09T19:29:40,389   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-10-09T19:29:40,390   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-10-09T19:29:40,392   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-10-09T19:29:40,394   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,396   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,399   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,402   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-09T19:29:40,405   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-10-09T19:29:40,406   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,408   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,452   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,455   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,458   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,461   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,463   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,468   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,470   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,472   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,474   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,477   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,479   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,481   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,484   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,487   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-09T19:29:40,489   running install_egg_info
2024-10-09T19:29:40,521   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.15.2-py3.9.egg-info
2024-10-09T19:29:40,533   running install_scripts
2024-10-09T19:29:40,535   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data
2024-10-09T19:29:40,536   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,537   copying build/scripts-3.9/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,539   copying build/scripts-3.9/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,541   copying build/scripts-3.9/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,543   copying build/scripts-3.9/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,545   copying build/scripts-3.9/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,547   copying build/scripts-3.9/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,549   copying build/scripts-3.9/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,550   copying build/scripts-3.9/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,552   copying build/scripts-3.9/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,554   copying build/scripts-3.9/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts
2024-10-09T19:29:40,556   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/ds_report to 755
2024-10-09T19:29:40,556   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/deepspeed.pt to 755
2024-10-09T19:29:40,557   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/ds_io to 755
2024-10-09T19:29:40,557   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/ds_ssh to 755
2024-10-09T19:29:40,558   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/dsr to 755
2024-10-09T19:29:40,559   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/ds to 755
2024-10-09T19:29:40,559   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/ds_nvme_tune to 755
2024-10-09T19:29:40,560   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/ds_elastic to 755
2024-10-09T19:29:40,560   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/deepspeed to 755
2024-10-09T19:29:40,561   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.data/scripts/ds_bench to 755
2024-10-09T19:29:40,620   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.2.dist-info/WHEEL
2024-10-09T19:29:40,623   creating '/tmp/pip-wheel-xao2rgxt/deepspeed-0.15.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-10-09T19:29:40,626   adding 'deepspeed/__init__.py'
2024-10-09T19:29:40,628   adding 'deepspeed/constants.py'
2024-10-09T19:29:40,629   adding 'deepspeed/env_report.py'
2024-10-09T19:29:40,630   adding 'deepspeed/git_version_info.py'
2024-10-09T19:29:40,632   adding 'deepspeed/git_version_info_installed.py'
2024-10-09T19:29:40,633   adding 'deepspeed/accelerator/__init__.py'
2024-10-09T19:29:40,635   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-10-09T19:29:40,637   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-10-09T19:29:40,639   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-10-09T19:29:40,640   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-10-09T19:29:40,642   adding 'deepspeed/accelerator/mlu_accelerator.py'
2024-10-09T19:29:40,644   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-10-09T19:29:40,646   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-10-09T19:29:40,647   adding 'deepspeed/accelerator/real_accelerator.py'
2024-10-09T19:29:40,649   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-10-09T19:29:40,651   adding 'deepspeed/autotuning/__init__.py'
2024-10-09T19:29:40,656   adding 'deepspeed/autotuning/autotuner.py'
2024-10-09T19:29:40,658   adding 'deepspeed/autotuning/config.py'
2024-10-09T19:29:40,659   adding 'deepspeed/autotuning/constants.py'
2024-10-09T19:29:40,662   adding 'deepspeed/autotuning/scheduler.py'
2024-10-09T19:29:40,664   adding 'deepspeed/autotuning/utils.py'
2024-10-09T19:29:40,666   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-10-09T19:29:40,667   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-10-09T19:29:40,668   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-10-09T19:29:40,669   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-10-09T19:29:40,671   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-10-09T19:29:40,672   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-10-09T19:29:40,674   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-10-09T19:29:40,675   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-10-09T19:29:40,676   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-10-09T19:29:40,678   adding 'deepspeed/autotuning/tuner/utils.py'
2024-10-09T19:29:40,679   adding 'deepspeed/checkpoint/__init__.py'
2024-10-09T19:29:40,681   adding 'deepspeed/checkpoint/constants.py'
2024-10-09T19:29:40,683   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-10-09T19:29:40,686   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-10-09T19:29:40,687   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-10-09T19:29:40,689   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-10-09T19:29:40,690   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-10-09T19:29:40,692   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-10-09T19:29:40,693   adding 'deepspeed/checkpoint/utils.py'
2024-10-09T19:29:40,695   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-10-09T19:29:40,696   adding 'deepspeed/comm/__init__.py'
2024-10-09T19:29:40,698   adding 'deepspeed/comm/backend.py'
2024-10-09T19:29:40,699   adding 'deepspeed/comm/ccl.py'
2024-10-09T19:29:40,702   adding 'deepspeed/comm/comm.py'
2024-10-09T19:29:40,704   adding 'deepspeed/comm/config.py'
2024-10-09T19:29:40,705   adding 'deepspeed/comm/constants.py'
2024-10-09T19:29:40,706   adding 'deepspeed/comm/reduce_op.py'
2024-10-09T19:29:40,708   adding 'deepspeed/comm/torch.py'
2024-10-09T19:29:40,710   adding 'deepspeed/comm/utils.py'
2024-10-09T19:29:40,712   adding 'deepspeed/compression/__init__.py'
2024-10-09T19:29:40,715   adding 'deepspeed/compression/basic_layer.py'
2024-10-09T19:29:40,717   adding 'deepspeed/compression/compress.py'
2024-10-09T19:29:40,719   adding 'deepspeed/compression/config.py'
2024-10-09T19:29:40,721   adding 'deepspeed/compression/constants.py'
2024-10-09T19:29:40,723   adding 'deepspeed/compression/helper.py'
2024-10-09T19:29:40,724   adding 'deepspeed/compression/scheduler.py'
2024-10-09T19:29:40,726   adding 'deepspeed/compression/utils.py'
2024-10-09T19:29:40,728   adding 'deepspeed/elasticity/__init__.py'
2024-10-09T19:29:40,729   adding 'deepspeed/elasticity/config.py'
2024-10-09T19:29:40,730   adding 'deepspeed/elasticity/constants.py'
2024-10-09T19:29:40,732   adding 'deepspeed/elasticity/elastic_agent.py'
2024-10-09T19:29:40,734   adding 'deepspeed/elasticity/elasticity.py'
2024-10-09T19:29:40,736   adding 'deepspeed/elasticity/utils.py'
2024-10-09T19:29:40,737   adding 'deepspeed/inference/__init__.py'
2024-10-09T19:29:40,739   adding 'deepspeed/inference/config.py'
2024-10-09T19:29:40,743   adding 'deepspeed/inference/engine.py'
2024-10-09T19:29:40,745   adding 'deepspeed/inference/quantization/__init__.py'
2024-10-09T19:29:40,746   adding 'deepspeed/inference/quantization/layers.py'
2024-10-09T19:29:40,747   adding 'deepspeed/inference/quantization/quantization.py'
2024-10-09T19:29:40,749   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-10-09T19:29:40,751   adding 'deepspeed/inference/quantization/utils.py'
2024-10-09T19:29:40,752   adding 'deepspeed/inference/v2/__init__.py'
2024-10-09T19:29:40,754   adding 'deepspeed/inference/v2/allocator.py'
2024-10-09T19:29:40,755   adding 'deepspeed/inference/v2/config_v2.py'
2024-10-09T19:29:40,756   adding 'deepspeed/inference/v2/engine_factory.py'
2024-10-09T19:29:40,758   adding 'deepspeed/inference/v2/engine_v2.py'
2024-10-09T19:29:40,759   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-10-09T19:29:40,761   adding 'deepspeed/inference/v2/inference_utils.py'
2024-10-09T19:29:40,762   adding 'deepspeed/inference/v2/logging.py'
2024-10-09T19:29:40,763   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-10-09T19:29:40,765   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-10-09T19:29:40,766   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-10-09T19:29:40,768   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-10-09T19:29:40,769   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-10-09T19:29:40,771   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-10-09T19:29:40,772   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-10-09T19:29:40,774   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-10-09T19:29:40,775   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-10-09T19:29:40,777   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-10-09T19:29:40,778   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-10-09T19:29:40,779   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-10-09T19:29:40,780   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-10-09T19:29:40,782   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-10-09T19:29:40,783   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-10-09T19:29:40,785   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-10-09T19:29:40,786   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-10-09T19:29:40,788   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-10-09T19:29:40,790   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-10-09T19:29:40,791   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-10-09T19:29:40,792   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-10-09T19:29:40,793   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-10-09T19:29:40,795   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-10-09T19:29:40,796   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-10-09T19:29:40,797   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-10-09T19:29:40,800   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-10-09T19:29:40,802   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-10-09T19:29:40,803   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-10-09T19:29:40,805   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-10-09T19:29:40,806   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-10-09T19:29:40,808   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-10-09T19:29:40,809   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-10-09T19:29:40,811   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-10-09T19:29:40,813   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-10-09T19:29:40,815   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-10-09T19:29:40,816   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-10-09T19:29:40,817   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-10-09T19:29:40,819   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-10-09T19:29:40,821   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-10-09T19:29:40,822   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-10-09T19:29:40,824   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-10-09T19:29:40,826   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-10-09T19:29:40,827   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-10-09T19:29:40,828   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-10-09T19:29:40,830   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-10-09T19:29:40,831   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-10-09T19:29:40,833   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-10-09T19:29:40,834   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-10-09T19:29:40,835   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-10-09T19:29:40,837   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-10-09T19:29:40,838   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-10-09T19:29:40,840   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-10-09T19:29:40,841   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-10-09T19:29:40,843   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-10-09T19:29:40,844   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-10-09T19:29:40,846   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-10-09T19:29:40,847   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-10-09T19:29:40,848   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-10-09T19:29:40,849   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-10-09T19:29:40,851   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-10-09T19:29:40,852   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-10-09T19:29:40,854   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-10-09T19:29:40,855   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-10-09T19:29:40,856   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-10-09T19:29:40,858   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-10-09T19:29:40,859   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-10-09T19:29:40,861   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-10-09T19:29:40,862   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-10-09T19:29:40,864   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-10-09T19:29:40,865   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-10-09T19:29:40,868   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-10-09T19:29:40,871   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-10-09T19:29:40,872   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-10-09T19:29:40,874   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-10-09T19:29:40,875   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-10-09T19:29:40,876   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-10-09T19:29:40,878   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-10-09T19:29:40,879   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-10-09T19:29:40,880   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-10-09T19:29:40,882   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-10-09T19:29:40,883   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-10-09T19:29:40,884   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-10-09T19:29:40,886   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-10-09T19:29:40,887   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-10-09T19:29:40,889   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-10-09T19:29:40,890   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-10-09T19:29:40,891   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-10-09T19:29:40,892   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-10-09T19:29:40,894   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-10-09T19:29:40,895   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-10-09T19:29:40,897   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-10-09T19:29:40,899   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-10-09T19:29:40,900   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-10-09T19:29:40,901   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-10-09T19:29:40,903   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-10-09T19:29:40,904   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-10-09T19:29:40,906   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-10-09T19:29:40,907   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-10-09T19:29:40,909   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-10-09T19:29:40,910   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-10-09T19:29:40,912   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-10-09T19:29:40,913   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-10-09T19:29:40,914   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-10-09T19:29:40,915   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-10-09T19:29:40,917   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-10-09T19:29:40,918   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-10-09T19:29:40,920   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-10-09T19:29:40,921   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-10-09T19:29:40,922   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-10-09T19:29:40,923   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-10-09T19:29:40,925   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-10-09T19:29:40,927   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-10-09T19:29:40,928   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-10-09T19:29:40,929   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-10-09T19:29:40,930   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-10-09T19:29:40,932   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-10-09T19:29:40,933   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-10-09T19:29:40,935   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-10-09T19:29:40,936   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-10-09T19:29:40,937   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-10-09T19:29:40,939   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-10-09T19:29:40,940   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-10-09T19:29:40,942   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-10-09T19:29:40,943   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-10-09T19:29:40,944   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-10-09T19:29:40,945   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-10-09T19:29:40,947   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-10-09T19:29:40,949   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-10-09T19:29:40,951   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-10-09T19:29:40,953   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-10-09T19:29:40,955   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-10-09T19:29:40,958   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-10-09T19:29:40,959   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-10-09T19:29:40,961   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-10-09T19:29:40,962   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-10-09T19:29:40,964   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-10-09T19:29:40,965   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-10-09T19:29:40,966   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-10-09T19:29:40,967   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-10-09T19:29:40,969   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-10-09T19:29:40,970   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-10-09T19:29:40,971   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-10-09T19:29:40,973   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-10-09T19:29:40,974   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-10-09T19:29:40,976   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-10-09T19:29:40,977   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-10-09T19:29:40,979   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-10-09T19:29:40,980   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-10-09T19:29:40,982   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-10-09T19:29:40,983   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-10-09T19:29:40,985   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-10-09T19:29:40,986   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-10-09T19:29:40,988   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-10-09T19:29:40,989   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-10-09T19:29:40,991   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-10-09T19:29:40,992   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-10-09T19:29:40,994   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-10-09T19:29:40,995   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-10-09T19:29:40,996   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-10-09T19:29:40,998   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-10-09T19:29:40,999   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-10-09T19:29:41,001   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-10-09T19:29:41,002   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-10-09T19:29:41,003   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-10-09T19:29:41,005   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-10-09T19:29:41,006   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-10-09T19:29:41,008   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-10-09T19:29:41,009   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-10-09T19:29:41,011   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-10-09T19:29:41,012   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-10-09T19:29:41,014   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-10-09T19:29:41,015   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-10-09T19:29:41,017   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-10-09T19:29:41,018   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-10-09T19:29:41,020   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-10-09T19:29:41,021   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-10-09T19:29:41,023   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-10-09T19:29:41,024   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-10-09T19:29:41,026   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-10-09T19:29:41,027   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-10-09T19:29:41,029   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-10-09T19:29:41,030   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-10-09T19:29:41,032   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-10-09T19:29:41,033   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-10-09T19:29:41,035   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-10-09T19:29:41,036   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-10-09T19:29:41,037   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-10-09T19:29:41,039   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-10-09T19:29:41,040   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-10-09T19:29:41,041   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-10-09T19:29:41,043   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-10-09T19:29:41,045   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-10-09T19:29:41,046   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-10-09T19:29:41,047   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-10-09T19:29:41,049   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-10-09T19:29:41,050   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-10-09T19:29:41,052   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-10-09T19:29:41,053   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-10-09T19:29:41,054   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-10-09T19:29:41,056   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-10-09T19:29:41,057   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-10-09T19:29:41,058   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-10-09T19:29:41,060   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-10-09T19:29:41,062   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-10-09T19:29:41,063   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-10-09T19:29:41,065   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-10-09T19:29:41,066   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-10-09T19:29:41,068   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-10-09T19:29:41,070   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-10-09T19:29:41,072   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-10-09T19:29:41,073   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-10-09T19:29:41,075   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-10-09T19:29:41,077   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-10-09T19:29:41,078   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-10-09T19:29:41,079   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-10-09T19:29:41,081   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-10-09T19:29:41,082   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-10-09T19:29:41,084   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-10-09T19:29:41,085   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-10-09T19:29:41,087   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-10-09T19:29:41,088   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-10-09T19:29:41,090   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-10-09T19:29:41,091   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-10-09T19:29:41,092   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-10-09T19:29:41,094   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-10-09T19:29:41,095   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-10-09T19:29:41,096   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-10-09T19:29:41,098   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-10-09T19:29:41,099   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-10-09T19:29:41,101   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-10-09T19:29:41,103   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-10-09T19:29:41,104   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-10-09T19:29:41,106   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-10-09T19:29:41,108   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-10-09T19:29:41,110   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-10-09T19:29:41,111   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-10-09T19:29:41,113   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-10-09T19:29:41,114   adding 'deepspeed/launcher/__init__.py'
2024-10-09T19:29:41,115   adding 'deepspeed/launcher/constants.py'
2024-10-09T19:29:41,118   adding 'deepspeed/launcher/launch.py'
2024-10-09T19:29:41,119   adding 'deepspeed/launcher/launcher_helper.py'
2024-10-09T19:29:41,121   adding 'deepspeed/launcher/multinode_runner.py'
2024-10-09T19:29:41,124   adding 'deepspeed/launcher/runner.py'
2024-10-09T19:29:41,126   adding 'deepspeed/linear/__init__.py'
2024-10-09T19:29:41,128   adding 'deepspeed/linear/config.py'
2024-10-09T19:29:41,129   adding 'deepspeed/linear/context_manager.py'
2024-10-09T19:29:41,131   adding 'deepspeed/linear/optimized_linear.py'
2024-10-09T19:29:41,133   adding 'deepspeed/linear/quantization.py'
2024-10-09T19:29:41,134   adding 'deepspeed/model_implementations/__init__.py'
2024-10-09T19:29:41,136   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-10-09T19:29:41,137   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-10-09T19:29:41,139   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-10-09T19:29:41,140   adding 'deepspeed/model_implementations/features/__init__.py'
2024-10-09T19:29:41,141   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-10-09T19:29:41,143   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-10-09T19:29:41,144   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-10-09T19:29:41,145   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-10-09T19:29:41,147   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-10-09T19:29:41,148   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-10-09T19:29:41,149   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-10-09T19:29:41,150   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-10-09T19:29:41,152   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-10-09T19:29:41,153   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-10-09T19:29:41,155   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-10-09T19:29:41,156   adding 'deepspeed/module_inject/__init__.py'
2024-10-09T19:29:41,159   adding 'deepspeed/module_inject/auto_tp.py'
2024-10-09T19:29:41,161   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-10-09T19:29:41,163   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-10-09T19:29:41,164   adding 'deepspeed/module_inject/inject.py'
2024-10-09T19:29:41,166   adding 'deepspeed/module_inject/layers.py'
2024-10-09T19:29:41,168   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-10-09T19:29:41,169   adding 'deepspeed/module_inject/module_quantize.py'
2024-10-09T19:29:41,171   adding 'deepspeed/module_inject/policy.py'
2024-10-09T19:29:41,175   adding 'deepspeed/module_inject/replace_module.py'
2024-10-09T19:29:41,176   adding 'deepspeed/module_inject/replace_policy.py'
2024-10-09T19:29:41,177   adding 'deepspeed/module_inject/tp_shard.py'
2024-10-09T19:29:41,178   adding 'deepspeed/module_inject/utils.py'
2024-10-09T19:29:41,180   adding 'deepspeed/module_inject/containers/__init__.py'
2024-10-09T19:29:41,182   adding 'deepspeed/module_inject/containers/base.py'
2024-10-09T19:29:41,184   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-10-09T19:29:41,185   adding 'deepspeed/module_inject/containers/bert.py'
2024-10-09T19:29:41,187   adding 'deepspeed/module_inject/containers/bloom.py'
2024-10-09T19:29:41,188   adding 'deepspeed/module_inject/containers/clip.py'
2024-10-09T19:29:41,189   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-10-09T19:29:41,191   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-10-09T19:29:41,192   adding 'deepspeed/module_inject/containers/gptj.py'
2024-10-09T19:29:41,193   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-10-09T19:29:41,195   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-10-09T19:29:41,196   adding 'deepspeed/module_inject/containers/internlm.py'
2024-10-09T19:29:41,198   adding 'deepspeed/module_inject/containers/llama.py'
2024-10-09T19:29:41,199   adding 'deepspeed/module_inject/containers/llama2.py'
2024-10-09T19:29:41,201   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-10-09T19:29:41,202   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-10-09T19:29:41,204   adding 'deepspeed/module_inject/containers/opt.py'
2024-10-09T19:29:41,205   adding 'deepspeed/module_inject/containers/unet.py'
2024-10-09T19:29:41,206   adding 'deepspeed/module_inject/containers/vae.py'
2024-10-09T19:29:41,208   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-10-09T19:29:41,209   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-10-09T19:29:41,211   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-10-09T19:29:41,213   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-10-09T19:29:41,214   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-10-09T19:29:41,215   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-10-09T19:29:41,217   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-10-09T19:29:41,218   adding 'deepspeed/moe/__init__.py'
2024-10-09T19:29:41,219   adding 'deepspeed/moe/experts.py'
2024-10-09T19:29:41,221   adding 'deepspeed/moe/layer.py'
2024-10-09T19:29:41,222   adding 'deepspeed/moe/mappings.py'
2024-10-09T19:29:41,226   adding 'deepspeed/moe/sharded_moe.py'
2024-10-09T19:29:41,227   adding 'deepspeed/moe/utils.py'
2024-10-09T19:29:41,229   adding 'deepspeed/monitor/__init__.py'
2024-10-09T19:29:41,230   adding 'deepspeed/monitor/comet.py'
2024-10-09T19:29:41,232   adding 'deepspeed/monitor/config.py'
2024-10-09T19:29:41,233   adding 'deepspeed/monitor/csv_monitor.py'
2024-10-09T19:29:41,235   adding 'deepspeed/monitor/monitor.py'
2024-10-09T19:29:41,236   adding 'deepspeed/monitor/tensorboard.py'
2024-10-09T19:29:41,237   adding 'deepspeed/monitor/utils.py'
2024-10-09T19:29:41,238   adding 'deepspeed/monitor/wandb.py'
2024-10-09T19:29:41,240   adding 'deepspeed/nebula/__init__.py'
2024-10-09T19:29:41,241   adding 'deepspeed/nebula/config.py'
2024-10-09T19:29:41,243   adding 'deepspeed/nebula/constants.py'
2024-10-09T19:29:41,244   adding 'deepspeed/nvme/__init__.py'
2024-10-09T19:29:41,246   adding 'deepspeed/nvme/ds_aio_args.py'
2024-10-09T19:29:41,247   adding 'deepspeed/nvme/ds_aio_basic.py'
2024-10-09T19:29:41,249   adding 'deepspeed/nvme/ds_aio_handle.py'
2024-10-09T19:29:41,250   adding 'deepspeed/nvme/ds_aio_job.py'
2024-10-09T19:29:41,252   adding 'deepspeed/nvme/parse_nvme_stats.py'
2024-10-09T19:29:41,253   adding 'deepspeed/nvme/perf_generate_param.py'
2024-10-09T19:29:41,255   adding 'deepspeed/nvme/perf_run_sweep.py'
2024-10-09T19:29:41,256   adding 'deepspeed/nvme/perf_sweep_utils.py'
2024-10-09T19:29:41,257   adding 'deepspeed/nvme/test_ds_aio.py'
2024-10-09T19:29:41,259   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2024-10-09T19:29:41,260   adding 'deepspeed/nvme/validate_async_io.py'
2024-10-09T19:29:41,262   adding 'deepspeed/ops/__init__.py'
2024-10-09T19:29:41,263   adding 'deepspeed/ops/adagrad/__init__.py'
2024-10-09T19:29:41,265   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-10-09T19:29:41,266   adding 'deepspeed/ops/adam/__init__.py'
2024-10-09T19:29:41,268   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-10-09T19:29:41,270   adding 'deepspeed/ops/adam/fused_adam.py'
2024-10-09T19:29:41,271   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-10-09T19:29:41,273   adding 'deepspeed/ops/aio/__init__.py'
2024-10-09T19:29:41,275   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-10-09T19:29:41,277   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-10-09T19:29:41,279   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-10-09T19:29:41,280   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-10-09T19:29:41,281   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-10-09T19:29:41,283   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-10-09T19:29:41,286   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-10-09T19:29:41,287   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-10-09T19:29:41,288   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-10-09T19:29:41,290   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-10-09T19:29:41,291   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-10-09T19:29:41,293   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-10-09T19:29:41,294   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2024-10-09T19:29:41,296   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2024-10-09T19:29:41,297   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-10-09T19:29:41,298   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-10-09T19:29:41,300   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2024-10-09T19:29:41,301   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2024-10-09T19:29:41,302   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-10-09T19:29:41,303   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-10-09T19:29:41,305   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-10-09T19:29:41,306   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-10-09T19:29:41,307   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-10-09T19:29:41,308   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-10-09T19:29:41,309   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-10-09T19:29:41,311   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-10-09T19:29:41,312   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2024-10-09T19:29:41,314   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2024-10-09T19:29:41,315   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-10-09T19:29:41,317   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-10-09T19:29:41,319   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-10-09T19:29:41,321   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-10-09T19:29:41,324   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-10-09T19:29:41,326   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-10-09T19:29:41,327   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-10-09T19:29:41,329   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-10-09T19:29:41,331   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-10-09T19:29:41,333   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-10-09T19:29:41,335   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-10-09T19:29:41,337   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-10-09T19:29:41,345   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-10-09T19:29:41,350   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-10-09T19:29:41,353   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-10-09T19:29:41,355   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-10-09T19:29:41,357   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-10-09T19:29:41,359   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-10-09T19:29:41,361   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-10-09T19:29:41,362   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-10-09T19:29:41,365   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-10-09T19:29:41,368   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-10-09T19:29:41,370   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-10-09T19:29:41,372   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-10-09T19:29:41,379   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-10-09T19:29:41,383   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-10-09T19:29:41,385   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-10-09T19:29:41,389   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-10-09T19:29:41,393   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-10-09T19:29:41,397   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-10-09T19:29:41,398   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-10-09T19:29:41,400   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-10-09T19:29:41,402   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-10-09T19:29:41,404   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-10-09T19:29:41,406   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-10-09T19:29:41,408   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-10-09T19:29:41,410   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-10-09T19:29:41,412   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-10-09T19:29:41,414   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2024-10-09T19:29:41,415   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2024-10-09T19:29:41,417   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2024-10-09T19:29:41,418   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2024-10-09T19:29:41,420   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2024-10-09T19:29:41,421   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2024-10-09T19:29:41,423   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-10-09T19:29:41,425   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-10-09T19:29:41,426   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-10-09T19:29:41,427   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-10-09T19:29:41,428   adding 'deepspeed/ops/csrc/includes/context.h'
2024-10-09T19:29:41,430   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-10-09T19:29:41,432   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-10-09T19:29:41,433   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-10-09T19:29:41,435   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-10-09T19:29:41,436   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-10-09T19:29:41,438   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-10-09T19:29:41,440   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-10-09T19:29:41,441   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-10-09T19:29:41,442   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-10-09T19:29:41,444   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-10-09T19:29:41,445   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-10-09T19:29:41,446   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-10-09T19:29:41,448   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-10-09T19:29:41,449   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-10-09T19:29:41,452   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-10-09T19:29:41,454   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-10-09T19:29:41,455   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-10-09T19:29:41,457   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-10-09T19:29:41,458   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-10-09T19:29:41,461   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-10-09T19:29:41,463   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-10-09T19:29:41,464   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-10-09T19:29:41,466   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-10-09T19:29:41,467   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-10-09T19:29:41,469   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-10-09T19:29:41,471   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-10-09T19:29:41,473   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-10-09T19:29:41,475   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-10-09T19:29:41,476   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-10-09T19:29:41,477   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-10-09T19:29:41,479   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-10-09T19:29:41,481   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-10-09T19:29:41,484   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-10-09T19:29:41,486   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-10-09T19:29:41,487   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-10-09T19:29:41,489   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-10-09T19:29:41,491   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-10-09T19:29:41,492   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-10-09T19:29:41,494   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-10-09T19:29:41,496   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-10-09T19:29:41,497   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-10-09T19:29:41,499   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-10-09T19:29:41,501   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-10-09T19:29:41,503   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-10-09T19:29:41,504   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-10-09T19:29:41,506   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-10-09T19:29:41,508   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-10-09T19:29:41,511   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-10-09T19:29:41,515   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-10-09T19:29:41,517   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-10-09T19:29:41,519   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-10-09T19:29:41,523   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-10-09T19:29:41,526   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-10-09T19:29:41,529   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-10-09T19:29:41,532   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-10-09T19:29:41,533   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-10-09T19:29:41,536   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-10-09T19:29:41,539   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-10-09T19:29:41,540   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-10-09T19:29:41,546   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-10-09T19:29:41,548   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-10-09T19:29:41,550   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-10-09T19:29:41,552   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-10-09T19:29:41,555   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-10-09T19:29:41,558   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-10-09T19:29:41,560   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-10-09T19:29:41,561   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-10-09T19:29:41,563   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-10-09T19:29:41,565   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-10-09T19:29:41,567   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-10-09T19:29:41,569   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-10-09T19:29:41,570   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-10-09T19:29:41,572   adding 'deepspeed/ops/csrc/xpu/aio/deepspeed_cpu_op.cpp'
2024-10-09T19:29:41,574   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-10-09T19:29:41,576   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-10-09T19:29:41,577   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-10-09T19:29:41,579   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-10-09T19:29:41,580   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-10-09T19:29:41,582   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-10-09T19:29:41,584   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-10-09T19:29:41,585   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-10-09T19:29:41,587   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-10-09T19:29:41,588   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-10-09T19:29:41,590   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-10-09T19:29:41,592   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-10-09T19:29:41,593   adding 'deepspeed/ops/gds/__init__.py'
2024-10-09T19:29:41,595   adding 'deepspeed/ops/lamb/__init__.py'
2024-10-09T19:29:41,597   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-10-09T19:29:41,598   adding 'deepspeed/ops/lion/__init__.py'
2024-10-09T19:29:41,600   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-10-09T19:29:41,601   adding 'deepspeed/ops/lion/fused_lion.py'
2024-10-09T19:29:41,603   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-10-09T19:29:41,605   adding 'deepspeed/ops/op_builder/__init__.py'
2024-10-09T19:29:41,606   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-10-09T19:29:41,607   adding 'deepspeed/ops/op_builder/async_io.py'
2024-10-09T19:29:41,611   adding 'deepspeed/ops/op_builder/builder.py'
2024-10-09T19:29:41,613   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-10-09T19:29:41,614   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-10-09T19:29:41,615   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-10-09T19:29:41,616   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-10-09T19:29:41,618   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-10-09T19:29:41,619   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-10-09T19:29:41,620   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-10-09T19:29:41,621   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-10-09T19:29:41,623   adding 'deepspeed/ops/op_builder/gds.py'
2024-10-09T19:29:41,624   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-10-09T19:29:41,626   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-10-09T19:29:41,627   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-10-09T19:29:41,628   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-10-09T19:29:41,630   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-10-09T19:29:41,631   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-10-09T19:29:41,632   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-10-09T19:29:41,634   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-10-09T19:29:41,635   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-10-09T19:29:41,636   adding 'deepspeed/ops/op_builder/transformer.py'
2024-10-09T19:29:41,637   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-10-09T19:29:41,639   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-10-09T19:29:41,640   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-10-09T19:29:41,641   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-10-09T19:29:41,643   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-10-09T19:29:41,644   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-10-09T19:29:41,645   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-10-09T19:29:41,647   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-10-09T19:29:41,648   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-10-09T19:29:41,649   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-10-09T19:29:41,651   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-10-09T19:29:41,652   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-10-09T19:29:41,653   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2024-10-09T19:29:41,655   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2024-10-09T19:29:41,656   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2024-10-09T19:29:41,657   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2024-10-09T19:29:41,658   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2024-10-09T19:29:41,660   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2024-10-09T19:29:41,661   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2024-10-09T19:29:41,663   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-10-09T19:29:41,664   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-10-09T19:29:41,666   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-10-09T19:29:41,667   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-10-09T19:29:41,668   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-10-09T19:29:41,669   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-10-09T19:29:41,671   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-10-09T19:29:41,672   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-10-09T19:29:41,674   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-10-09T19:29:41,675   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-10-09T19:29:41,677   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-10-09T19:29:41,678   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-10-09T19:29:41,680   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-10-09T19:29:41,681   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-10-09T19:29:41,682   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-10-09T19:29:41,683   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-10-09T19:29:41,685   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-10-09T19:29:41,686   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-10-09T19:29:41,687   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-10-09T19:29:41,689   adding 'deepspeed/ops/quantizer/__init__.py'
2024-10-09T19:29:41,690   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-10-09T19:29:41,692   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-10-09T19:29:41,693   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-10-09T19:29:41,695   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-10-09T19:29:41,696   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-10-09T19:29:41,700   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-10-09T19:29:41,702   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-10-09T19:29:41,704   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-10-09T19:29:41,706   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-10-09T19:29:41,709   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-10-09T19:29:41,711   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-10-09T19:29:41,713   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-10-09T19:29:41,714   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-10-09T19:29:41,715   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-10-09T19:29:41,717   adding 'deepspeed/ops/transformer/__init__.py'
2024-10-09T19:29:41,720   adding 'deepspeed/ops/transformer/transformer.py'
2024-10-09T19:29:41,724   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-10-09T19:29:41,725   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-10-09T19:29:41,727   adding 'deepspeed/ops/transformer/inference/config.py'
2024-10-09T19:29:41,728   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-10-09T19:29:41,730   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-10-09T19:29:41,731   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-10-09T19:29:41,733   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-10-09T19:29:41,735   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-10-09T19:29:41,737   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-10-09T19:29:41,739   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-10-09T19:29:41,741   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-10-09T19:29:41,742   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-10-09T19:29:41,743   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2024-10-09T19:29:41,744   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2024-10-09T19:29:41,746   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2024-10-09T19:29:41,747   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2024-10-09T19:29:41,748   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2024-10-09T19:29:41,749   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2024-10-09T19:29:41,751   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-10-09T19:29:41,752   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2024-10-09T19:29:41,753   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-10-09T19:29:41,755   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-10-09T19:29:41,756   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2024-10-09T19:29:41,757   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2024-10-09T19:29:41,758   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2024-10-09T19:29:41,760   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-10-09T19:29:41,761   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-10-09T19:29:41,763   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2024-10-09T19:29:41,764   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-10-09T19:29:41,765   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-10-09T19:29:41,767   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2024-10-09T19:29:41,768   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-10-09T19:29:41,770   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2024-10-09T19:29:41,772   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-10-09T19:29:41,774   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-10-09T19:29:41,775   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-10-09T19:29:41,777   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-10-09T19:29:41,779   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-10-09T19:29:41,780   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-10-09T19:29:41,782   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-10-09T19:29:41,783   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-10-09T19:29:41,784   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-10-09T19:29:41,786   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-10-09T19:29:41,788   adding 'deepspeed/pipe/__init__.py'
2024-10-09T19:29:41,790   adding 'deepspeed/profiling/__init__.py'
2024-10-09T19:29:41,791   adding 'deepspeed/profiling/config.py'
2024-10-09T19:29:41,792   adding 'deepspeed/profiling/constants.py'
2024-10-09T19:29:41,794   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-10-09T19:29:41,799   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-10-09T19:29:41,802   adding 'deepspeed/runtime/__init__.py'
2024-10-09T19:29:41,803   adding 'deepspeed/runtime/base_optimizer.py'
2024-10-09T19:29:41,806   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-10-09T19:29:41,807   adding 'deepspeed/runtime/compiler.py'
2024-10-09T19:29:41,811   adding 'deepspeed/runtime/config.py'
2024-10-09T19:29:41,813   adding 'deepspeed/runtime/config_utils.py'
2024-10-09T19:29:41,816   adding 'deepspeed/runtime/constants.py'
2024-10-09T19:29:41,817   adding 'deepspeed/runtime/dataloader.py'
2024-10-09T19:29:41,819   adding 'deepspeed/runtime/eigenvalue.py'
2024-10-09T19:29:41,838   adding 'deepspeed/runtime/engine.py'
2024-10-09T19:29:41,842   adding 'deepspeed/runtime/hybrid_engine.py'
2024-10-09T19:29:41,845   adding 'deepspeed/runtime/lr_schedules.py'
2024-10-09T19:29:41,847   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-10-09T19:29:41,849   adding 'deepspeed/runtime/quantize.py'
2024-10-09T19:29:41,850   adding 'deepspeed/runtime/sparse_tensor.py'
2024-10-09T19:29:41,852   adding 'deepspeed/runtime/state_dict_factory.py'
2024-10-09T19:29:41,857   adding 'deepspeed/runtime/utils.py'
2024-10-09T19:29:41,859   adding 'deepspeed/runtime/weight_quantizer.py'
2024-10-09T19:29:41,861   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-10-09T19:29:41,866   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-10-09T19:29:41,867   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-10-09T19:29:41,869   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-10-09T19:29:41,870   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-10-09T19:29:41,872   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-10-09T19:29:41,873   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-10-09T19:29:41,875   adding 'deepspeed/runtime/comm/__init__.py'
2024-10-09T19:29:41,876   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-10-09T19:29:41,878   adding 'deepspeed/runtime/comm/compressed.py'
2024-10-09T19:29:41,879   adding 'deepspeed/runtime/comm/hccl.py'
2024-10-09T19:29:41,881   adding 'deepspeed/runtime/comm/mpi.py'
2024-10-09T19:29:41,882   adding 'deepspeed/runtime/comm/nccl.py'
2024-10-09T19:29:41,884   adding 'deepspeed/runtime/compression/__init__.py'
2024-10-09T19:29:41,885   adding 'deepspeed/runtime/compression/cupy.py'
2024-10-09T19:29:41,887   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-10-09T19:29:41,888   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-10-09T19:29:41,890   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-10-09T19:29:41,891   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-10-09T19:29:41,893   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-10-09T19:29:41,895   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-10-09T19:29:41,896   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-10-09T19:29:41,897   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-10-09T19:29:41,899   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-10-09T19:29:41,900   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-10-09T19:29:41,905   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-10-09T19:29:41,908   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-10-09T19:29:41,911   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-10-09T19:29:41,912   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-10-09T19:29:41,914   adding 'deepspeed/runtime/fp16/__init__.py'
2024-10-09T19:29:41,917   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-10-09T19:29:41,919   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-10-09T19:29:41,921   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-10-09T19:29:41,923   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-10-09T19:29:41,925   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-10-09T19:29:41,928   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-10-09T19:29:41,931   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-10-09T19:29:41,933   adding 'deepspeed/runtime/pipe/__init__.py'
2024-10-09T19:29:41,940   adding 'deepspeed/runtime/pipe/engine.py'
2024-10-09T19:29:41,944   adding 'deepspeed/runtime/pipe/module.py'
2024-10-09T19:29:41,946   adding 'deepspeed/runtime/pipe/p2p.py'
2024-10-09T19:29:41,948   adding 'deepspeed/runtime/pipe/schedule.py'
2024-10-09T19:29:41,951   adding 'deepspeed/runtime/pipe/topology.py'
2024-10-09T19:29:41,952   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-10-09T19:29:41,954   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-10-09T19:29:41,955   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-10-09T19:29:41,956   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-10-09T19:29:41,959   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-10-09T19:29:41,961   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-10-09T19:29:41,963   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-10-09T19:29:41,965   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-10-09T19:29:41,967   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-10-09T19:29:41,968   adding 'deepspeed/runtime/zero/__init__.py'
2024-10-09T19:29:41,971   adding 'deepspeed/runtime/zero/config.py'
2024-10-09T19:29:41,972   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-10-09T19:29:41,974   adding 'deepspeed/runtime/zero/linear.py'
2024-10-09T19:29:41,977   adding 'deepspeed/runtime/zero/mics.py'
2024-10-09T19:29:41,979   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-10-09T19:29:41,980   adding 'deepspeed/runtime/zero/offload_config.py'
2024-10-09T19:29:41,983   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-10-09T19:29:41,995   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-10-09T19:29:41,999   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-10-09T19:29:42,000   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-10-09T19:29:42,016   adding 'deepspeed/runtime/zero/stage3.py'
2024-10-09T19:29:42,030   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-10-09T19:29:42,032   adding 'deepspeed/runtime/zero/test.py'
2024-10-09T19:29:42,034   adding 'deepspeed/runtime/zero/tiling.py'
2024-10-09T19:29:42,036   adding 'deepspeed/runtime/zero/utils.py'
2024-10-09T19:29:42,038   adding 'deepspeed/sequence/__init__.py'
2024-10-09T19:29:42,039   adding 'deepspeed/sequence/cross_entropy.py'
2024-10-09T19:29:42,041   adding 'deepspeed/sequence/layer.py'
2024-10-09T19:29:42,043   adding 'deepspeed/utils/__init__.py'
2024-10-09T19:29:42,044   adding 'deepspeed/utils/bwc.py'
2024-10-09T19:29:42,046   adding 'deepspeed/utils/comms_logging.py'
2024-10-09T19:29:42,047   adding 'deepspeed/utils/config.py'
2024-10-09T19:29:42,048   adding 'deepspeed/utils/debug.py'
2024-10-09T19:29:42,050   adding 'deepspeed/utils/exceptions.py'
2024-10-09T19:29:42,052   adding 'deepspeed/utils/groups.py'
2024-10-09T19:29:42,054   adding 'deepspeed/utils/init_on_device.py'
2024-10-09T19:29:42,055   adding 'deepspeed/utils/logging.py'
2024-10-09T19:29:42,057   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-10-09T19:29:42,058   adding 'deepspeed/utils/numa.py'
2024-10-09T19:29:42,059   adding 'deepspeed/utils/nvtx.py'
2024-10-09T19:29:42,061   adding 'deepspeed/utils/tensor_fragment.py'
2024-10-09T19:29:42,063   adding 'deepspeed/utils/timer.py'
2024-10-09T19:29:42,064   adding 'deepspeed/utils/torch.py'
2024-10-09T19:29:42,065   adding 'deepspeed/utils/types.py'
2024-10-09T19:29:42,067   adding 'deepspeed/utils/z3_leaf_module.py'
2024-10-09T19:29:42,070   adding 'deepspeed/utils/zero_to_fp32.py'
2024-10-09T19:29:42,073   adding 'deepspeed-0.15.2.data/scripts/deepspeed'
2024-10-09T19:29:42,074   adding 'deepspeed-0.15.2.data/scripts/deepspeed.pt'
2024-10-09T19:29:42,075   adding 'deepspeed-0.15.2.data/scripts/ds'
2024-10-09T19:29:42,076   adding 'deepspeed-0.15.2.data/scripts/ds_bench'
2024-10-09T19:29:42,077   adding 'deepspeed-0.15.2.data/scripts/ds_elastic'
2024-10-09T19:29:42,078   adding 'deepspeed-0.15.2.data/scripts/ds_io'
2024-10-09T19:29:42,080   adding 'deepspeed-0.15.2.data/scripts/ds_nvme_tune'
2024-10-09T19:29:42,081   adding 'deepspeed-0.15.2.data/scripts/ds_report'
2024-10-09T19:29:42,082   adding 'deepspeed-0.15.2.data/scripts/ds_ssh'
2024-10-09T19:29:42,083   adding 'deepspeed-0.15.2.data/scripts/dsr'
2024-10-09T19:29:42,086   adding 'deepspeed-0.15.2.dist-info/LICENSE'
2024-10-09T19:29:42,091   adding 'deepspeed-0.15.2.dist-info/METADATA'
2024-10-09T19:29:42,093   adding 'deepspeed-0.15.2.dist-info/WHEEL'
2024-10-09T19:29:42,094   adding 'deepspeed-0.15.2.dist-info/entry_points.txt'
2024-10-09T19:29:42,094   adding 'deepspeed-0.15.2.dist-info/top_level.txt'
2024-10-09T19:29:42,109   adding 'deepspeed-0.15.2.dist-info/RECORD'
2024-10-09T19:29:42,137   removing build/bdist.linux-armv7l/wheel
2024-10-09T19:29:42,362   deepspeed build time = 10.6450355052948 secs
2024-10-09T19:29:42,465   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-10-09T19:29:42,483   Created wheel for deepspeed: filename=deepspeed-0.15.2-py3-none-any.whl size=1521802 sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e
2024-10-09T19:29:42,484   Stored in directory: /tmp/pip-ephem-wheel-cache-wn8bwzhk/wheels/8f/06/ce/8231c6947ffd31523807e46172cde00e69a2c041ed415869c1
2024-10-09T19:29:42,525 Successfully built deepspeed
2024-10-09T19:29:42,570 Removed build tracker: '/tmp/pip-build-tracker-654xqalk'