2024-10-23T00:37:31,321 Disabling truststore because Python version isn't 3.10+
2024-10-23T00:37:31,891 Created temporary directory: /tmp/pip-build-tracker-39viodqg
2024-10-23T00:37:31,892 Initialized build tracking at /tmp/pip-build-tracker-39viodqg
2024-10-23T00:37:31,892 Created build tracker: /tmp/pip-build-tracker-39viodqg
2024-10-23T00:37:31,893 Entered build tracker: /tmp/pip-build-tracker-39viodqg
2024-10-23T00:37:31,893 Created temporary directory: /tmp/pip-wheel-4hp66byi
2024-10-23T00:37:31,898 Created temporary directory: /tmp/pip-ephem-wheel-cache-wzorzkz9
2024-10-23T00:37:31,946 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-10-23T00:37:31,949 2 location(s) to search for versions of deepspeed:
2024-10-23T00:37:31,949 * https://pypi.org/simple/deepspeed/
2024-10-23T00:37:31,949 * https://www.piwheels.org/simple/deepspeed/
2024-10-23T00:37:31,949 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-10-23T00:37:31,950 Getting page https://pypi.org/simple/deepspeed/
2024-10-23T00:37:31,951 Found index url https://pypi.org/simple/
2024-10-23T00:37:31,972 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-10-23T00:37:31,990   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-23T00:37:31,990   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-10-23T00:37:31,991   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-23T00:37:31,991   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-10-23T00:37:31,991   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-23T00:37:31,991   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-10-23T00:37:31,992   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-23T00:37:31,992   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-10-23T00:37:31,992   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-10-23T00:37:31,992   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-10-23T00:37:31,993   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-10-23T00:37:31,993   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-10-23T00:37:31,993   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-10-23T00:37:31,993   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-10-23T00:37:31,994   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-10-23T00:37:31,994   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-10-23T00:37:31,994   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-10-23T00:37:31,995   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-10-23T00:37:31,995   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-10-23T00:37:31,995   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-10-23T00:37:31,995   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-10-23T00:37:31,996   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-10-23T00:37:31,996   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-10-23T00:37:31,996   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-10-23T00:37:31,996   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-10-23T00:37:31,997   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-10-23T00:37:31,997   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-10-23T00:37:31,997   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-10-23T00:37:31,997   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-10-23T00:37:31,998   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-10-23T00:37:31,998   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-10-23T00:37:31,998   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-10-23T00:37:31,998   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-10-23T00:37:31,999   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-10-23T00:37:31,999   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-10-23T00:37:31,999   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-10-23T00:37:31,999   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-10-23T00:37:32,000   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-10-23T00:37:32,000   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-10-23T00:37:32,000   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-10-23T00:37:32,000   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-10-23T00:37:32,001   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-10-23T00:37:32,001   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-10-23T00:37:32,001   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-10-23T00:37:32,001   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-10-23T00:37:32,002   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-10-23T00:37:32,002   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-10-23T00:37:32,002   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-10-23T00:37:32,002   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-10-23T00:37:32,003   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-10-23T00:37:32,003   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-10-23T00:37:32,003   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-10-23T00:37:32,003   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-10-23T00:37:32,004   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-10-23T00:37:32,004   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-10-23T00:37:32,004   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-10-23T00:37:32,005   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-10-23T00:37:32,005   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-10-23T00:37:32,005   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-10-23T00:37:32,005   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-10-23T00:37:32,006   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-10-23T00:37:32,006   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-10-23T00:37:32,006   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-10-23T00:37:32,006   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-10-23T00:37:32,007   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-10-23T00:37:32,007   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-10-23T00:37:32,007   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-10-23T00:37:32,007   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-10-23T00:37:32,008   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-10-23T00:37:32,008   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-10-23T00:37:32,008   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-10-23T00:37:32,008   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-10-23T00:37:32,009   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-10-23T00:37:32,009   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-10-23T00:37:32,009   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-10-23T00:37:32,010   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-10-23T00:37:32,010   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-10-23T00:37:32,010   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-10-23T00:37:32,010   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-10-23T00:37:32,011   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-10-23T00:37:32,011   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-10-23T00:37:32,011   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-10-23T00:37:32,011   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-10-23T00:37:32,012   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-10-23T00:37:32,012   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-10-23T00:37:32,012   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-10-23T00:37:32,012   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-10-23T00:37:32,013   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-10-23T00:37:32,013   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-10-23T00:37:32,013   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-10-23T00:37:32,013   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-10-23T00:37:32,014   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-10-23T00:37:32,014   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-10-23T00:37:32,014   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-10-23T00:37:32,014   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-10-23T00:37:32,015   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-10-23T00:37:32,015   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-10-23T00:37:32,015   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-10-23T00:37:32,015   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-10-23T00:37:32,016   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2024-10-23T00:37:32,016   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2024-10-23T00:37:32,016   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2024-10-23T00:37:32,016   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2024-10-23T00:37:32,017 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-10-23T00:37:32,017 Getting page https://www.piwheels.org/simple/deepspeed/
2024-10-23T00:37:32,018 Found index url https://www.piwheels.org/simple/
2024-10-23T00:37:32,062 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-10-23T00:37:32,081   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,081   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,081   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,081   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,082   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,082   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,082   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,082   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,082   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,083   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,083   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,083   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,083   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,083   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,084   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,084   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,084   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,084   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,084   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,085   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,085   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,085   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,085   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,085   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,085   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,086   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,086   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,086   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,086   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,086   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,087   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,087   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,087   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,087   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,087   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,088   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,088   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,088   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,088   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,088   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,089   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,089   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,089   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,089   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,089   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,089   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,090   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,090   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,090   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,090   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,090   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,091   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,091   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,091   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,091   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,091   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,092   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,092   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,092   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,092   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,092   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,093   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,093   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,093   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,093   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,093   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,093   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,094   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,094   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,094   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-10-23T00:37:32,094 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-10-23T00:37:32,095 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-10-23T00:37:32,122 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-10-23T00:37:32,125 Collecting deepspeed==0.15.3
2024-10-23T00:37:32,127   Created temporary directory: /tmp/pip-unpack-lch50obn
2024-10-23T00:37:32,148   Downloading deepspeed-0.15.3.tar.gz (1.4 MB)
2024-10-23T00:37:34,658   Added deepspeed==0.15.3 from https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz to build tracker '/tmp/pip-build-tracker-39viodqg'
2024-10-23T00:37:34,660   Running setup.py (path:/tmp/pip-wheel-4hp66byi/deepspeed_e50a7e14d2db4b2499217f9606d87811/setup.py) egg_info for package deepspeed
2024-10-23T00:37:34,661   Created temporary directory: /tmp/pip-pip-egg-info-h31xrxo8
2024-10-23T00:37:34,661   Preparing metadata (setup.py): started
2024-10-23T00:37:34,662   Running command python setup.py egg_info
2024-10-23T00:37:36,201   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-10-23T00:37:36,202    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-10-23T00:37:36,202   DS_BUILD_OPS=0
2024-10-23T00:37:36,202   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-10-23T00:37:36,202   version=0.15.3, git_hash=unknown, git_branch=unknown
2024-10-23T00:37:36,203   install_requires=['hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-10-23T00:37:36,203   ext_modules=[]
2024-10-23T00:37:36,203   running egg_info
2024-10-23T00:37:36,203   creating /tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info
2024-10-23T00:37:36,231   writing /tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info/PKG-INFO
2024-10-23T00:37:36,278   writing dependency_links to /tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info/dependency_links.txt
2024-10-23T00:37:36,280   writing entry points to /tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info/entry_points.txt
2024-10-23T00:37:36,305   writing requirements to /tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info/requires.txt
2024-10-23T00:37:36,307   writing top-level names to /tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info/top_level.txt
2024-10-23T00:37:36,308   writing manifest file '/tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info/SOURCES.txt'
2024-10-23T00:37:36,566   reading manifest file '/tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info/SOURCES.txt'
2024-10-23T00:37:36,568   reading manifest template 'MANIFEST.in'
2024-10-23T00:37:36,570   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-10-23T00:37:36,571   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-10-23T00:37:38,239   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-10-23T00:37:39,219   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-10-23T00:37:39,869   warning: no files found matching '*.tr' under directory 'csrc'
2024-10-23T00:37:39,988   warning: no files found matching '*.cc' under directory 'csrc'
2024-10-23T00:37:40,033   warning: no files found matching '*.py' under directory 'benchmarks'
2024-10-23T00:37:40,039   adding license file 'LICENSE'
2024-10-23T00:37:40,089   writing manifest file '/tmp/pip-pip-egg-info-h31xrxo8/deepspeed.egg-info/SOURCES.txt'
2024-10-23T00:37:40,091   deepspeed build time = 4.443609714508057 secs
2024-10-23T00:37:40,187   Preparing metadata (setup.py): finished with status 'done'
2024-10-23T00:37:40,194   Source in /tmp/pip-wheel-4hp66byi/deepspeed_e50a7e14d2db4b2499217f9606d87811 has version 0.15.3, which satisfies requirement deepspeed==0.15.3 from https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz
2024-10-23T00:37:40,195   Removed deepspeed==0.15.3 from https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz from build tracker '/tmp/pip-build-tracker-39viodqg'
2024-10-23T00:37:40,230 Created temporary directory: /tmp/pip-unpack-vg5mjcmq
2024-10-23T00:37:40,231 Created temporary directory: /tmp/pip-unpack-ra7a6g_w
2024-10-23T00:37:40,231 Building wheels for collected packages: deepspeed
2024-10-23T00:37:40,235   Created temporary directory: /tmp/pip-wheel-w49tgtph
2024-10-23T00:37:40,235   Building wheel for deepspeed (setup.py): started
2024-10-23T00:37:40,236   Destination directory: /tmp/pip-wheel-w49tgtph
2024-10-23T00:37:40,236   Running command python setup.py bdist_wheel
2024-10-23T00:37:40,724   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-10-23T00:37:40,732    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-10-23T00:37:40,824   DS_BUILD_OPS=0
2024-10-23T00:37:40,953   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-10-23T00:37:40,981   version=0.15.3, git_hash=unknown, git_branch=unknown
2024-10-23T00:37:40,982   install_requires=['hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-10-23T00:37:40,982   ext_modules=[]
2024-10-23T00:37:41,457   running bdist_wheel
2024-10-23T00:37:41,596   running build
2024-10-23T00:37:41,596   running build_py
2024-10-23T00:37:41,627   creating build
2024-10-23T00:37:41,628   creating build/lib
2024-10-23T00:37:41,629   creating build/lib/deepspeed
2024-10-23T00:37:41,630   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-10-23T00:37:41,632   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-10-23T00:37:41,633   copying deepspeed/constants.py -> build/lib/deepspeed
2024-10-23T00:37:41,635   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-10-23T00:37:41,637   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-10-23T00:37:41,639   creating build/lib/deepspeed/ops
2024-10-23T00:37:41,640   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-10-23T00:37:41,643   creating build/lib/deepspeed/comm
2024-10-23T00:37:41,643   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,645   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,647   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,649   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,651   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,653   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,655   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,656   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,658   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-10-23T00:37:41,660   creating build/lib/deepspeed/pipe
2024-10-23T00:37:41,661   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-10-23T00:37:41,663   creating build/lib/deepspeed/linear
2024-10-23T00:37:41,664   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-10-23T00:37:41,666   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-10-23T00:37:41,667   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-10-23T00:37:41,669   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-10-23T00:37:41,671   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-10-23T00:37:41,673   creating build/lib/deepspeed/module_inject
2024-10-23T00:37:41,674   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,676   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,677   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,680   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,682   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,684   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,686   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,689   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,691   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,693   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,695   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,697   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,698   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-10-23T00:37:41,701   creating build/lib/deepspeed/runtime
2024-10-23T00:37:41,702   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,704   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,706   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,708   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,711   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,713   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,715   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,718   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,720   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,723   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,725   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,731   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,733   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,735   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,738   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,739   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,741   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,743   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-10-23T00:37:41,746   creating build/lib/deepspeed/profiling
2024-10-23T00:37:41,747   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-10-23T00:37:41,749   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-10-23T00:37:41,750   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-10-23T00:37:41,753   creating build/lib/deepspeed/utils
2024-10-23T00:37:41,754   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,756   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,758   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,760   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,762   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,764   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,766   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,769   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,771   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,774   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,775   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,777   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,779   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,780   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,782   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,784   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,786   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,788   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-10-23T00:37:41,798   creating build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,799   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,802   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,804   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,807   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,809   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,811   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,813   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,814   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,817   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,819   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-10-23T00:37:41,821   creating build/lib/deepspeed/nebula
2024-10-23T00:37:41,822   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-10-23T00:37:41,824   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-10-23T00:37:41,826   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-10-23T00:37:41,829   creating build/lib/deepspeed/launcher
2024-10-23T00:37:41,830   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-10-23T00:37:41,833   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-10-23T00:37:41,834   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-10-23T00:37:41,837   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-10-23T00:37:41,839   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-10-23T00:37:41,841   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-10-23T00:37:41,843   creating build/lib/deepspeed/sequence
2024-10-23T00:37:41,844   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-10-23T00:37:41,847   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2024-10-23T00:37:41,848   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-10-23T00:37:41,850   creating build/lib/deepspeed/autotuning
2024-10-23T00:37:41,851   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-10-23T00:37:41,855   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-10-23T00:37:41,857   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-10-23T00:37:41,859   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-10-23T00:37:41,861   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-10-23T00:37:41,863   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-10-23T00:37:41,865   creating build/lib/deepspeed/compression
2024-10-23T00:37:41,866   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-10-23T00:37:41,869   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-10-23T00:37:41,871   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-10-23T00:37:41,873   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-10-23T00:37:41,875   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-10-23T00:37:41,878   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-10-23T00:37:41,880   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-10-23T00:37:41,883   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-10-23T00:37:41,885   creating build/lib/deepspeed/model_implementations
2024-10-23T00:37:41,886   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-10-23T00:37:41,888   creating build/lib/deepspeed/monitor
2024-10-23T00:37:41,889   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-10-23T00:37:41,891   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-10-23T00:37:41,892   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-10-23T00:37:41,894   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-10-23T00:37:41,896   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-10-23T00:37:41,898   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-10-23T00:37:41,899   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-10-23T00:37:41,901   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-10-23T00:37:41,904   creating build/lib/deepspeed/nvme
2024-10-23T00:37:41,905   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,907   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,909   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,911   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,912   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,914   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,915   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,917   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,919   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,921   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,922   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,924   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2024-10-23T00:37:41,926   creating build/lib/deepspeed/elasticity
2024-10-23T00:37:41,927   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-10-23T00:37:41,929   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-10-23T00:37:41,931   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-10-23T00:37:41,933   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-10-23T00:37:41,935   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-10-23T00:37:41,937   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-10-23T00:37:41,939   creating build/lib/deepspeed/accelerator
2024-10-23T00:37:41,940   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,942   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,944   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,946   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,948   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,950   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,952   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,954   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,956   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,959   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-10-23T00:37:41,961   creating build/lib/deepspeed/inference
2024-10-23T00:37:41,962   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-10-23T00:37:41,965   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-10-23T00:37:41,967   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-10-23T00:37:41,969   creating build/lib/deepspeed/moe
2024-10-23T00:37:41,970   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-10-23T00:37:41,972   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-10-23T00:37:41,974   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-10-23T00:37:41,976   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-10-23T00:37:41,977   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-10-23T00:37:41,980   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-10-23T00:37:41,982   creating build/lib/deepspeed/ops/deepspeed4science
2024-10-23T00:37:41,983   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-10-23T00:37:41,985   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-10-23T00:37:41,987   creating build/lib/deepspeed/ops/random_ltd
2024-10-23T00:37:41,988   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-10-23T00:37:41,990   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-10-23T00:37:41,992   creating build/lib/deepspeed/ops/adagrad
2024-10-23T00:37:41,993   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-10-23T00:37:41,995   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-10-23T00:37:41,997   creating build/lib/deepspeed/ops/gds
2024-10-23T00:37:41,998   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2024-10-23T00:37:42,000   creating build/lib/deepspeed/ops/sparse_attention
2024-10-23T00:37:42,001   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-23T00:37:42,003   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-23T00:37:42,005   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-23T00:37:42,008   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-23T00:37:42,010   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-23T00:37:42,013   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-23T00:37:42,014   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-10-23T00:37:42,017   creating build/lib/deepspeed/ops/quantizer
2024-10-23T00:37:42,018   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-10-23T00:37:42,019   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-10-23T00:37:42,022   creating build/lib/deepspeed/ops/lion
2024-10-23T00:37:42,022   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-10-23T00:37:42,025   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-10-23T00:37:42,026   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-10-23T00:37:42,028   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-10-23T00:37:42,030   creating build/lib/deepspeed/ops/fp_quantizer
2024-10-23T00:37:42,031   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-10-23T00:37:42,033   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-10-23T00:37:42,035   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-10-23T00:37:42,037   creating build/lib/deepspeed/ops/transformer
2024-10-23T00:37:42,038   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-10-23T00:37:42,041   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-10-23T00:37:42,044   creating build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,045   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,046   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,048   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,049   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,051   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,053   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,054   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,056   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,057   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,059   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,061   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,064   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,066   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,067   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,069   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,070   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,072   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,074   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,075   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,077   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,079   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,080   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,082   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,083   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-10-23T00:37:42,086   creating build/lib/deepspeed/ops/adam
2024-10-23T00:37:42,087   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-10-23T00:37:42,088   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-10-23T00:37:42,090   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-10-23T00:37:42,092   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-10-23T00:37:42,094   creating build/lib/deepspeed/ops/aio
2024-10-23T00:37:42,095   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-10-23T00:37:42,097   creating build/lib/deepspeed/ops/lamb
2024-10-23T00:37:42,098   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-10-23T00:37:42,100   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-10-23T00:37:42,102   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:42,103   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:42,106   creating build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,107   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,109   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,111   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,113   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,115   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,117   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,119   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,121   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,123   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,125   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-10-23T00:37:42,128   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,129   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,131   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,133   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,134   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,136   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,138   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,140   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,142   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,143   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,145   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,147   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,148   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,150   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,151   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,153   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,155   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,157   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,158   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,160   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,161   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,163   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,165   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,166   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:42,169   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,170   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,171   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,174   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,175   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,178   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,179   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,181   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,183   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,185   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,187   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:42,189   creating build/lib/deepspeed/ops/op_builder/mlu
2024-10-23T00:37:42,190   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-23T00:37:42,192   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-23T00:37:42,193   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-23T00:37:42,195   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-23T00:37:42,196   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-23T00:37:42,198   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-10-23T00:37:42,200   creating build/lib/deepspeed/ops/op_builder/hpu
2024-10-23T00:37:42,201   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-23T00:37:42,203   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-23T00:37:42,204   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-23T00:37:42,206   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-23T00:37:42,207   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-23T00:37:42,209   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-10-23T00:37:42,212   creating build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,212   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,214   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,216   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,217   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,219   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,221   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,222   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,225   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,226   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-10-23T00:37:42,229   creating build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,230   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,231   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,233   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,235   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,237   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,238   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,240   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,242   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,243   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,245   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:42,247   creating build/lib/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:42,248   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:42,249   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:42,251   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:42,253   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:42,254   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:42,256   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:42,258   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:42,260   creating build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,261   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,263   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,265   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,267   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,269   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,270   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,272   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,274   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,276   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,278   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,280   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,282   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,284   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,286   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,288   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,290   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,291   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,293   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,296   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-10-23T00:37:42,299   creating build/lib/deepspeed/module_inject/containers/features
2024-10-23T00:37:42,300   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-23T00:37:42,302   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-23T00:37:42,304   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-23T00:37:42,306   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-23T00:37:42,307   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-23T00:37:42,309   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-23T00:37:42,311   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-10-23T00:37:42,314   creating build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,315   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,317   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,319   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,322   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,323   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,326   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,328   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,330   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,334   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,335   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,340   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,342   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,345   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,348   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,349   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,352   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,354   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-10-23T00:37:42,357   creating build/lib/deepspeed/runtime/comm
2024-10-23T00:37:42,358   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-10-23T00:37:42,360   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-10-23T00:37:42,362   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-10-23T00:37:42,364   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-10-23T00:37:42,366   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-10-23T00:37:42,368   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-10-23T00:37:42,371   creating build/lib/deepspeed/runtime/data_pipeline
2024-10-23T00:37:42,372   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-10-23T00:37:42,374   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-10-23T00:37:42,376   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-10-23T00:37:42,378   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-10-23T00:37:42,380   creating build/lib/deepspeed/runtime/pipe
2024-10-23T00:37:42,381   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-10-23T00:37:42,384   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-10-23T00:37:42,387   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-10-23T00:37:42,390   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-10-23T00:37:42,392   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-10-23T00:37:42,394   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-10-23T00:37:42,397   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:42,398   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:42,400   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:42,401   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:42,403   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:42,406   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-10-23T00:37:42,407   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-10-23T00:37:42,410   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-10-23T00:37:42,411   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-10-23T00:37:42,414   creating build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,415   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,417   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,419   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,421   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,423   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,426   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,427   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,429   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,432   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-10-23T00:37:42,435   creating build/lib/deepspeed/runtime/compression
2024-10-23T00:37:42,436   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-10-23T00:37:42,438   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-10-23T00:37:42,440   creating build/lib/deepspeed/runtime/fp16
2024-10-23T00:37:42,441   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-10-23T00:37:42,443   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-10-23T00:37:42,446   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-10-23T00:37:42,447   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-10-23T00:37:42,451   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:42,451   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:42,454   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:42,456   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:42,459   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:42,461   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:42,464   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:42,465   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:42,467   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:42,469   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:42,471   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:42,473   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:42,475   creating build/lib/deepspeed/runtime/fp16/onebit
2024-10-23T00:37:42,476   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-10-23T00:37:42,479   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-10-23T00:37:42,480   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-10-23T00:37:42,483   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-10-23T00:37:42,486   creating build/lib/deepspeed/profiling/flops_profiler
2024-10-23T00:37:42,487   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-10-23T00:37:42,488   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-10-23T00:37:42,492   creating build/lib/deepspeed/autotuning/tuner
2024-10-23T00:37:42,493   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-10-23T00:37:42,495   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-10-23T00:37:42,497   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-10-23T00:37:42,499   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-10-23T00:37:42,500   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-10-23T00:37:42,502   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-10-23T00:37:42,505   creating build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,506   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,507   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,510   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,511   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,513   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,515   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,517   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,518   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,520   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,522   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-10-23T00:37:42,524   creating build/lib/deepspeed/model_implementations/features
2024-10-23T00:37:42,525   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-10-23T00:37:42,526   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-10-23T00:37:42,529   creating build/lib/deepspeed/model_implementations/diffusers
2024-10-23T00:37:42,530   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-10-23T00:37:42,531   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-10-23T00:37:42,533   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-10-23T00:37:42,536   creating build/lib/deepspeed/inference/quantization
2024-10-23T00:37:42,537   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-10-23T00:37:42,539   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-10-23T00:37:42,541   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-10-23T00:37:42,543   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-10-23T00:37:42,545   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-10-23T00:37:42,547   creating build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,548   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,550   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,552   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,554   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,556   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,558   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,559   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,561   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,563   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-10-23T00:37:42,566   creating build/lib/deepspeed/inference/v2/ragged
2024-10-23T00:37:42,567   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-23T00:37:42,569   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-23T00:37:42,571   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-23T00:37:42,573   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-23T00:37:42,575   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-23T00:37:42,577   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-23T00:37:42,579   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-10-23T00:37:42,582   creating build/lib/deepspeed/inference/v2/checkpoint
2024-10-23T00:37:42,583   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-10-23T00:37:42,585   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-10-23T00:37:42,586   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-10-23T00:37:42,588   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-10-23T00:37:42,591   creating build/lib/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:42,592   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:42,594   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:42,596   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:42,599   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:42,601   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:42,603   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:42,605   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:42,608   creating build/lib/deepspeed/inference/v2/kernels
2024-10-23T00:37:42,609   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-10-23T00:37:42,610   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-10-23T00:37:42,613   creating build/lib/deepspeed/inference/v2/modules
2024-10-23T00:37:42,614   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-10-23T00:37:42,615   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-10-23T00:37:42,618   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-10-23T00:37:42,619   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-10-23T00:37:42,622   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,622   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,625   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,627   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,629   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,631   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,633   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,635   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,637   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,638   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:42,641   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:42,642   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:42,644   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:42,646   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:42,647   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:42,650   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:42,651   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:42,653   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:42,655   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:42,657   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:42,659   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:42,660   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:42,662   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:42,664   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:42,666   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:42,668   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:42,669   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:42,671   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:42,673   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:42,675   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:42,677   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:42,678   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:42,680   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:42,682   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:42,684   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:42,686   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:42,687   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:42,689   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:42,691   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:42,693   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:42,695   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:42,696   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:42,698   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:42,700   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:42,702   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:42,704   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:42,705   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:42,708   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:42,710   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:42,711   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:42,714   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,715   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,717   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,719   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,720   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,722   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,724   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,726   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,727   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,729   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:42,731   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:42,733   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:42,735   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:42,737   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:42,738   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:42,740   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:42,741   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:42,744   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:42,746   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:42,747   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:42,750   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-10-23T00:37:42,751   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-10-23T00:37:42,753   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-10-23T00:37:42,754   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-10-23T00:37:42,756   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-10-23T00:37:42,757   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-10-23T00:37:42,759   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:42,761   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:42,762   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:42,764   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:42,766   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:42,767   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:42,769   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:42,771   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:42,772   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:42,774   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:42,776   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:42,777   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:42,779   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:42,781   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:42,783   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:42,785   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:42,786   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:42,788   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:42,790   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:42,791   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:42,793   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:42,795   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:42,796   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:42,798   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:42,800   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:42,801   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:42,803   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:42,806   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:42,806   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:42,808   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:42,811   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:42,811   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:42,818   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:42,820   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:42,821   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:42,823   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:42,825   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:42,827   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:42,829   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:42,831   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:42,832   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:42,834   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:42,836   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:42,837   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:42,839   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:42,842   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:42,843   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:42,845   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:42,847   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:42,848   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:42,850   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:42,852   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:42,854   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:42,856   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:42,857   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:42,859   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:42,861   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-10-23T00:37:42,862   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-10-23T00:37:42,865   creating build/lib/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:42,866   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:42,867   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:42,869   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:42,871   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:42,873   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:42,875   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:42,876   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:42,879   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,880   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,882   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,883   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,885   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,887   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,889   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,891   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,892   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:42,895   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-10-23T00:37:42,896   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-10-23T00:37:42,898   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-10-23T00:37:42,900   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-10-23T00:37:42,902   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-10-23T00:37:42,903   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-10-23T00:37:42,905   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-10-23T00:37:42,907   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-10-23T00:37:42,908   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-10-23T00:37:42,910   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-10-23T00:37:42,912   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-10-23T00:37:42,913   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-10-23T00:37:42,915   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-10-23T00:37:42,918   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-23T00:37:42,919   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-23T00:37:42,921   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-23T00:37:42,922   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-23T00:37:42,924   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-10-23T00:37:42,925   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-10-23T00:37:42,927   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-10-23T00:37:42,930   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-10-23T00:37:42,931   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-10-23T00:37:42,933   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-10-23T00:37:42,936   running egg_info
2024-10-23T00:37:42,963   writing deepspeed.egg-info/PKG-INFO
2024-10-23T00:37:43,010   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-10-23T00:37:43,012   writing entry points to deepspeed.egg-info/entry_points.txt
2024-10-23T00:37:43,036   writing requirements to deepspeed.egg-info/requires.txt
2024-10-23T00:37:43,038   writing top-level names to deepspeed.egg-info/top_level.txt
2024-10-23T00:37:43,182   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-10-23T00:37:43,277   reading manifest template 'MANIFEST.in'
2024-10-23T00:37:43,278   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-10-23T00:37:43,279   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-10-23T00:37:44,879   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-10-23T00:37:45,798   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-10-23T00:37:46,415   warning: no files found matching '*.tr' under directory 'csrc'
2024-10-23T00:37:46,533   warning: no files found matching '*.cc' under directory 'csrc'
2024-10-23T00:37:46,576   warning: no files found matching '*.py' under directory 'benchmarks'
2024-10-23T00:37:46,582   adding license file 'LICENSE'
2024-10-23T00:37:46,652   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-10-23T00:37:46,663   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-10-23T00:37:46,663   !!

2024-10-23T00:37:46,664           ********************************************************************************
2024-10-23T00:37:46,664           ############################
2024-10-23T00:37:46,664           # Package would be ignored #
2024-10-23T00:37:46,664           ############################
2024-10-23T00:37:46,664           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-10-23T00:37:46,664           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,664           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,665           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-10-23T00:37:46,665           to the `packages` configuration field.

2024-10-23T00:37:46,665           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,665           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,665           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,665           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,666           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,666           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-10-23T00:37:46,666           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-10-23T00:37:46,666           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,666           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,666           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,667           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,667           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,667           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,667                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,667                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,667                 directory, all directories are treated like packages.
2024-10-23T00:37:46,668           ********************************************************************************

2024-10-23T00:37:46,668   !!
2024-10-23T00:37:46,668     check.warn(importable)
2024-10-23T00:37:46,668   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-10-23T00:37:46,668   !!

2024-10-23T00:37:46,669           ********************************************************************************
2024-10-23T00:37:46,669           ############################
2024-10-23T00:37:46,669           # Package would be ignored #
2024-10-23T00:37:46,669           ############################
2024-10-23T00:37:46,669           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-10-23T00:37:46,669           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,669           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,669           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-10-23T00:37:46,670           to the `packages` configuration field.

2024-10-23T00:37:46,670           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,670           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,670           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,670           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,670           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,671           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-10-23T00:37:46,671           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-10-23T00:37:46,671           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,671           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,671           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,671           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,672           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,672           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,672                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,672                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,672                 directory, all directories are treated like packages.
2024-10-23T00:37:46,672           ********************************************************************************

2024-10-23T00:37:46,673   !!
2024-10-23T00:37:46,673     check.warn(importable)
2024-10-23T00:37:46,673   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-10-23T00:37:46,673   !!

2024-10-23T00:37:46,673           ********************************************************************************
2024-10-23T00:37:46,673           ############################
2024-10-23T00:37:46,673           # Package would be ignored #
2024-10-23T00:37:46,673           ############################
2024-10-23T00:37:46,674           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-10-23T00:37:46,674           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,674           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,674           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-10-23T00:37:46,674           to the `packages` configuration field.

2024-10-23T00:37:46,674           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,674           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,675           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,675           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,675           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,675           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-10-23T00:37:46,675           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-10-23T00:37:46,675           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,676           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,676           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,676           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,676           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,676           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,677                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,677                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,677                 directory, all directories are treated like packages.
2024-10-23T00:37:46,677           ********************************************************************************

2024-10-23T00:37:46,677   !!
2024-10-23T00:37:46,677     check.warn(importable)
2024-10-23T00:37:46,677   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-10-23T00:37:46,678   !!

2024-10-23T00:37:46,678           ********************************************************************************
2024-10-23T00:37:46,678           ############################
2024-10-23T00:37:46,678           # Package would be ignored #
2024-10-23T00:37:46,678           ############################
2024-10-23T00:37:46,678           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-10-23T00:37:46,678           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,679           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,679           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-10-23T00:37:46,679           to the `packages` configuration field.

2024-10-23T00:37:46,679           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,679           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,679           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,679           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,680           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,680           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-10-23T00:37:46,680           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-10-23T00:37:46,680           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,680           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,680           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,681           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,681           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,681           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,681                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,681                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,682                 directory, all directories are treated like packages.
2024-10-23T00:37:46,682           ********************************************************************************

2024-10-23T00:37:46,682   !!
2024-10-23T00:37:46,682     check.warn(importable)
2024-10-23T00:37:46,682   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-10-23T00:37:46,682   !!

2024-10-23T00:37:46,682           ********************************************************************************
2024-10-23T00:37:46,683           ############################
2024-10-23T00:37:46,683           # Package would be ignored #
2024-10-23T00:37:46,683           ############################
2024-10-23T00:37:46,683           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-10-23T00:37:46,683           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,683           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,683           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-10-23T00:37:46,683           to the `packages` configuration field.

2024-10-23T00:37:46,684           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,684           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,684           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,684           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,684           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,685           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-10-23T00:37:46,685           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-10-23T00:37:46,685           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,685           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,685           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,685           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,685           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,686           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,686                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,686                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,686                 directory, all directories are treated like packages.
2024-10-23T00:37:46,686           ********************************************************************************

2024-10-23T00:37:46,686   !!
2024-10-23T00:37:46,687     check.warn(importable)
2024-10-23T00:37:46,687   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-10-23T00:37:46,687   !!

2024-10-23T00:37:46,687           ********************************************************************************
2024-10-23T00:37:46,687           ############################
2024-10-23T00:37:46,687           # Package would be ignored #
2024-10-23T00:37:46,687           ############################
2024-10-23T00:37:46,687           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-10-23T00:37:46,688           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,688           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,688           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-10-23T00:37:46,688           to the `packages` configuration field.

2024-10-23T00:37:46,688           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,688           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,688           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,689           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,689           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,689           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-10-23T00:37:46,689           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-10-23T00:37:46,689           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,689           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,689           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,690           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,690           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,690           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,690                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,690                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,690                 directory, all directories are treated like packages.
2024-10-23T00:37:46,691           ********************************************************************************

2024-10-23T00:37:46,691   !!
2024-10-23T00:37:46,691     check.warn(importable)
2024-10-23T00:37:46,691   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-10-23T00:37:46,691   !!

2024-10-23T00:37:46,691           ********************************************************************************
2024-10-23T00:37:46,691           ############################
2024-10-23T00:37:46,691           # Package would be ignored #
2024-10-23T00:37:46,692           ############################
2024-10-23T00:37:46,692           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-10-23T00:37:46,692           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,692           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,692           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-10-23T00:37:46,692           to the `packages` configuration field.

2024-10-23T00:37:46,692           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,693           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,693           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,693           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,693           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,693           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-10-23T00:37:46,693           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-10-23T00:37:46,693           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,694           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,694           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,694           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,694           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,695           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,695                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,695                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,695                 directory, all directories are treated like packages.
2024-10-23T00:37:46,695           ********************************************************************************

2024-10-23T00:37:46,695   !!
2024-10-23T00:37:46,695     check.warn(importable)
2024-10-23T00:37:46,695   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-10-23T00:37:46,696   !!

2024-10-23T00:37:46,696           ********************************************************************************
2024-10-23T00:37:46,696           ############################
2024-10-23T00:37:46,696           # Package would be ignored #
2024-10-23T00:37:46,696           ############################
2024-10-23T00:37:46,696           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-10-23T00:37:46,696           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,697           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,697           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-10-23T00:37:46,697           to the `packages` configuration field.

2024-10-23T00:37:46,697           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,697           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,697           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,697           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,698           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,698           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-10-23T00:37:46,698           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-10-23T00:37:46,698           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,698           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,698           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,699           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,699           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,699           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,699                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,699                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,699                 directory, all directories are treated like packages.
2024-10-23T00:37:46,700           ********************************************************************************

2024-10-23T00:37:46,700   !!
2024-10-23T00:37:46,700     check.warn(importable)
2024-10-23T00:37:46,700   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-10-23T00:37:46,700   !!

2024-10-23T00:37:46,700           ********************************************************************************
2024-10-23T00:37:46,700           ############################
2024-10-23T00:37:46,700           # Package would be ignored #
2024-10-23T00:37:46,701           ############################
2024-10-23T00:37:46,701           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-10-23T00:37:46,701           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,701           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,701           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-10-23T00:37:46,701           to the `packages` configuration field.

2024-10-23T00:37:46,701           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,701           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,702           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,702           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,702           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,702           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-10-23T00:37:46,702           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-10-23T00:37:46,702           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,702           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,703           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,703           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,703           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,703           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,703                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,704                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,704                 directory, all directories are treated like packages.
2024-10-23T00:37:46,704           ********************************************************************************

2024-10-23T00:37:46,704   !!
2024-10-23T00:37:46,704     check.warn(importable)
2024-10-23T00:37:46,704   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-10-23T00:37:46,704   !!

2024-10-23T00:37:46,705           ********************************************************************************
2024-10-23T00:37:46,705           ############################
2024-10-23T00:37:46,705           # Package would be ignored #
2024-10-23T00:37:46,705           ############################
2024-10-23T00:37:46,705           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-10-23T00:37:46,705           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,705           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,705           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-10-23T00:37:46,705           to the `packages` configuration field.

2024-10-23T00:37:46,706           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,706           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,706           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,706           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,706           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,707           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-10-23T00:37:46,707           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-10-23T00:37:46,707           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,707           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,707           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,707           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,707           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,708           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,708                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,708                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,708                 directory, all directories are treated like packages.
2024-10-23T00:37:46,708           ********************************************************************************

2024-10-23T00:37:46,708   !!
2024-10-23T00:37:46,708     check.warn(importable)
2024-10-23T00:37:46,708   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-10-23T00:37:46,709   !!

2024-10-23T00:37:46,709           ********************************************************************************
2024-10-23T00:37:46,709           ############################
2024-10-23T00:37:46,709           # Package would be ignored #
2024-10-23T00:37:46,709           ############################
2024-10-23T00:37:46,709           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-10-23T00:37:46,709           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,709           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,710           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-10-23T00:37:46,710           to the `packages` configuration field.

2024-10-23T00:37:46,710           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,710           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,710           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,710           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,711           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,711           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-10-23T00:37:46,711           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-10-23T00:37:46,711           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,711           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,711           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,711           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,712           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,712           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,712                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,712                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,712                 directory, all directories are treated like packages.
2024-10-23T00:37:46,712           ********************************************************************************

2024-10-23T00:37:46,713   !!
2024-10-23T00:37:46,713     check.warn(importable)
2024-10-23T00:37:46,713   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-10-23T00:37:46,713   !!

2024-10-23T00:37:46,713           ********************************************************************************
2024-10-23T00:37:46,714           ############################
2024-10-23T00:37:46,714           # Package would be ignored #
2024-10-23T00:37:46,714           ############################
2024-10-23T00:37:46,714           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-10-23T00:37:46,714           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,714           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,714           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-10-23T00:37:46,715           to the `packages` configuration field.

2024-10-23T00:37:46,715           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,715           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,715           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,715           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,715           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,716           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-10-23T00:37:46,716           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-10-23T00:37:46,716           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,716           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,716           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,716           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,716           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,717           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,717                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,717                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,717                 directory, all directories are treated like packages.
2024-10-23T00:37:46,717           ********************************************************************************

2024-10-23T00:37:46,717   !!
2024-10-23T00:37:46,717     check.warn(importable)
2024-10-23T00:37:46,718   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-10-23T00:37:46,718   !!

2024-10-23T00:37:46,718           ********************************************************************************
2024-10-23T00:37:46,718           ############################
2024-10-23T00:37:46,718           # Package would be ignored #
2024-10-23T00:37:46,718           ############################
2024-10-23T00:37:46,718           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-10-23T00:37:46,718           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,719           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,719           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-10-23T00:37:46,719           to the `packages` configuration field.

2024-10-23T00:37:46,719           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,719           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,719           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,719           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,720           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,720           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-10-23T00:37:46,720           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-10-23T00:37:46,720           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,720           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,720           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,721           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,721           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,721           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,721                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,721                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,721                 directory, all directories are treated like packages.
2024-10-23T00:37:46,721           ********************************************************************************

2024-10-23T00:37:46,722   !!
2024-10-23T00:37:46,722     check.warn(importable)
2024-10-23T00:37:46,722   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-10-23T00:37:46,722   !!

2024-10-23T00:37:46,722           ********************************************************************************
2024-10-23T00:37:46,722           ############################
2024-10-23T00:37:46,722           # Package would be ignored #
2024-10-23T00:37:46,723           ############################
2024-10-23T00:37:46,723           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-10-23T00:37:46,723           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,723           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,723           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-10-23T00:37:46,723           to the `packages` configuration field.

2024-10-23T00:37:46,723           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,723           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,724           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,724           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,724           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,724           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-10-23T00:37:46,724           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-10-23T00:37:46,724           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,725           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,725           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,725           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,725           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,725           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,725                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,726                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,726                 directory, all directories are treated like packages.
2024-10-23T00:37:46,726           ********************************************************************************

2024-10-23T00:37:46,726   !!
2024-10-23T00:37:46,726     check.warn(importable)
2024-10-23T00:37:46,726   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-10-23T00:37:46,726   !!

2024-10-23T00:37:46,726           ********************************************************************************
2024-10-23T00:37:46,727           ############################
2024-10-23T00:37:46,727           # Package would be ignored #
2024-10-23T00:37:46,727           ############################
2024-10-23T00:37:46,727           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-10-23T00:37:46,727           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,727           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,727           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-10-23T00:37:46,727           to the `packages` configuration field.

2024-10-23T00:37:46,728           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,728           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,728           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,728           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,728           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,729           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-10-23T00:37:46,729           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-10-23T00:37:46,729           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,729           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,729           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,729           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,729           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,730           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,730                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,730                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,730                 directory, all directories are treated like packages.
2024-10-23T00:37:46,730           ********************************************************************************

2024-10-23T00:37:46,730   !!
2024-10-23T00:37:46,731     check.warn(importable)
2024-10-23T00:37:46,731   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-10-23T00:37:46,731   !!

2024-10-23T00:37:46,731           ********************************************************************************
2024-10-23T00:37:46,731           ############################
2024-10-23T00:37:46,731           # Package would be ignored #
2024-10-23T00:37:46,731           ############################
2024-10-23T00:37:46,732           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-10-23T00:37:46,732           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,732           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,732           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-10-23T00:37:46,732           to the `packages` configuration field.

2024-10-23T00:37:46,732           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,732           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,732           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,733           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,733           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,733           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-10-23T00:37:46,733           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-10-23T00:37:46,733           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,733           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,733           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,734           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,734           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,734           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,734                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,734                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,735                 directory, all directories are treated like packages.
2024-10-23T00:37:46,735           ********************************************************************************

2024-10-23T00:37:46,735   !!
2024-10-23T00:37:46,735     check.warn(importable)
2024-10-23T00:37:46,735   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-10-23T00:37:46,735   !!

2024-10-23T00:37:46,735           ********************************************************************************
2024-10-23T00:37:46,735           ############################
2024-10-23T00:37:46,736           # Package would be ignored #
2024-10-23T00:37:46,736           ############################
2024-10-23T00:37:46,736           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-10-23T00:37:46,736           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,736           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,736           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-10-23T00:37:46,736           to the `packages` configuration field.

2024-10-23T00:37:46,737           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,737           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,737           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,737           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,737           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,737           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-10-23T00:37:46,737           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-10-23T00:37:46,738           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,738           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,738           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,738           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,738           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,739           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,739                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,739                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,739                 directory, all directories are treated like packages.
2024-10-23T00:37:46,739           ********************************************************************************

2024-10-23T00:37:46,739   !!
2024-10-23T00:37:46,739     check.warn(importable)
2024-10-23T00:37:46,739   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-10-23T00:37:46,739   !!

2024-10-23T00:37:46,740           ********************************************************************************
2024-10-23T00:37:46,740           ############################
2024-10-23T00:37:46,740           # Package would be ignored #
2024-10-23T00:37:46,740           ############################
2024-10-23T00:37:46,740           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-10-23T00:37:46,740           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,740           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,741           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-10-23T00:37:46,741           to the `packages` configuration field.

2024-10-23T00:37:46,741           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,741           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,741           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,741           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,741           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,742           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-10-23T00:37:46,742           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-10-23T00:37:46,742           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,742           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,742           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,742           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,742           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,743           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,743                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,743                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,743                 directory, all directories are treated like packages.
2024-10-23T00:37:46,743           ********************************************************************************

2024-10-23T00:37:46,743   !!
2024-10-23T00:37:46,744     check.warn(importable)
2024-10-23T00:37:46,744   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-10-23T00:37:46,744   !!

2024-10-23T00:37:46,744           ********************************************************************************
2024-10-23T00:37:46,744           ############################
2024-10-23T00:37:46,744           # Package would be ignored #
2024-10-23T00:37:46,744           ############################
2024-10-23T00:37:46,744           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-10-23T00:37:46,745           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,745           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,745           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-10-23T00:37:46,745           to the `packages` configuration field.

2024-10-23T00:37:46,745           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,745           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,745           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,746           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,746           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,746           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-10-23T00:37:46,746           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-10-23T00:37:46,746           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,746           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,747           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,747           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,747           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,747           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,747                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,747                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,748                 directory, all directories are treated like packages.
2024-10-23T00:37:46,748           ********************************************************************************

2024-10-23T00:37:46,748   !!
2024-10-23T00:37:46,748     check.warn(importable)
2024-10-23T00:37:46,748   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-10-23T00:37:46,748   !!

2024-10-23T00:37:46,748           ********************************************************************************
2024-10-23T00:37:46,749           ############################
2024-10-23T00:37:46,749           # Package would be ignored #
2024-10-23T00:37:46,749           ############################
2024-10-23T00:37:46,749           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-10-23T00:37:46,749           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,749           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,749           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-10-23T00:37:46,749           to the `packages` configuration field.

2024-10-23T00:37:46,750           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,750           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,750           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,750           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,750           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,750           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-10-23T00:37:46,750           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-10-23T00:37:46,751           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,751           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,751           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,751           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,751           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,752           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,752                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,752                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,752                 directory, all directories are treated like packages.
2024-10-23T00:37:46,752           ********************************************************************************

2024-10-23T00:37:46,752   !!
2024-10-23T00:37:46,752     check.warn(importable)
2024-10-23T00:37:46,752   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-10-23T00:37:46,752   !!

2024-10-23T00:37:46,753           ********************************************************************************
2024-10-23T00:37:46,753           ############################
2024-10-23T00:37:46,753           # Package would be ignored #
2024-10-23T00:37:46,753           ############################
2024-10-23T00:37:46,753           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-10-23T00:37:46,753           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,753           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,753           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-10-23T00:37:46,754           to the `packages` configuration field.

2024-10-23T00:37:46,754           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,754           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,754           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,754           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,754           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,755           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-10-23T00:37:46,755           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-10-23T00:37:46,755           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,755           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,755           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,755           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,755           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,756           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,756                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,756                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,756                 directory, all directories are treated like packages.
2024-10-23T00:37:46,756           ********************************************************************************

2024-10-23T00:37:46,756   !!
2024-10-23T00:37:46,757     check.warn(importable)
2024-10-23T00:37:46,757   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-10-23T00:37:46,757   !!

2024-10-23T00:37:46,757           ********************************************************************************
2024-10-23T00:37:46,757           ############################
2024-10-23T00:37:46,757           # Package would be ignored #
2024-10-23T00:37:46,757           ############################
2024-10-23T00:37:46,757           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-10-23T00:37:46,757           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,758           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,758           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-10-23T00:37:46,758           to the `packages` configuration field.

2024-10-23T00:37:46,758           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,758           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,758           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,758           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,759           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,759           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-10-23T00:37:46,759           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-10-23T00:37:46,759           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,759           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,759           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,760           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,760           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,760           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,760                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,760                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,760                 directory, all directories are treated like packages.
2024-10-23T00:37:46,761           ********************************************************************************

2024-10-23T00:37:46,761   !!
2024-10-23T00:37:46,761     check.warn(importable)
2024-10-23T00:37:46,761   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-10-23T00:37:46,761   !!

2024-10-23T00:37:46,761           ********************************************************************************
2024-10-23T00:37:46,761           ############################
2024-10-23T00:37:46,762           # Package would be ignored #
2024-10-23T00:37:46,762           ############################
2024-10-23T00:37:46,762           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-10-23T00:37:46,762           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,762           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,762           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-10-23T00:37:46,762           to the `packages` configuration field.

2024-10-23T00:37:46,763           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,763           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,763           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,763           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,763           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,763           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-10-23T00:37:46,763           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-10-23T00:37:46,764           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,764           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,764           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,764           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,764           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,765           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,765                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,765                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,765                 directory, all directories are treated like packages.
2024-10-23T00:37:46,765           ********************************************************************************

2024-10-23T00:37:46,765   !!
2024-10-23T00:37:46,765     check.warn(importable)
2024-10-23T00:37:46,765   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2024-10-23T00:37:46,766   !!

2024-10-23T00:37:46,766           ********************************************************************************
2024-10-23T00:37:46,766           ############################
2024-10-23T00:37:46,766           # Package would be ignored #
2024-10-23T00:37:46,766           ############################
2024-10-23T00:37:46,766           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2024-10-23T00:37:46,766           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,766           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,767           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2024-10-23T00:37:46,767           to the `packages` configuration field.

2024-10-23T00:37:46,767           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,767           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,767           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,767           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,768           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,768           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2024-10-23T00:37:46,768           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2024-10-23T00:37:46,768           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,768           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,768           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,768           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,769           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,769           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,769                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,769                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,769                 directory, all directories are treated like packages.
2024-10-23T00:37:46,769           ********************************************************************************

2024-10-23T00:37:46,770   !!
2024-10-23T00:37:46,770     check.warn(importable)
2024-10-23T00:37:46,770   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-10-23T00:37:46,770   !!

2024-10-23T00:37:46,770           ********************************************************************************
2024-10-23T00:37:46,770           ############################
2024-10-23T00:37:46,771           # Package would be ignored #
2024-10-23T00:37:46,771           ############################
2024-10-23T00:37:46,771           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-10-23T00:37:46,771           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,771           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,771           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-10-23T00:37:46,771           to the `packages` configuration field.

2024-10-23T00:37:46,772           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,772           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,772           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,772           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,772           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,772           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-10-23T00:37:46,772           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-10-23T00:37:46,773           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,773           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,773           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,773           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,773           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,774           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,774                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,774                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,774                 directory, all directories are treated like packages.
2024-10-23T00:37:46,774           ********************************************************************************

2024-10-23T00:37:46,774   !!
2024-10-23T00:37:46,774     check.warn(importable)
2024-10-23T00:37:46,774   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-10-23T00:37:46,775   !!

2024-10-23T00:37:46,775           ********************************************************************************
2024-10-23T00:37:46,775           ############################
2024-10-23T00:37:46,775           # Package would be ignored #
2024-10-23T00:37:46,775           ############################
2024-10-23T00:37:46,775           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-10-23T00:37:46,775           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,776           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,776           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-10-23T00:37:46,776           to the `packages` configuration field.

2024-10-23T00:37:46,776           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,776           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,776           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,776           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,777           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,777           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-10-23T00:37:46,777           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-10-23T00:37:46,777           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,777           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,777           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,777           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,778           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,778           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,778                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,778                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,778                 directory, all directories are treated like packages.
2024-10-23T00:37:46,779           ********************************************************************************

2024-10-23T00:37:46,779   !!
2024-10-23T00:37:46,779     check.warn(importable)
2024-10-23T00:37:46,779   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-10-23T00:37:46,779   !!

2024-10-23T00:37:46,779           ********************************************************************************
2024-10-23T00:37:46,779           ############################
2024-10-23T00:37:46,780           # Package would be ignored #
2024-10-23T00:37:46,780           ############################
2024-10-23T00:37:46,780           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-10-23T00:37:46,780           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,780           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,780           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-10-23T00:37:46,780           to the `packages` configuration field.

2024-10-23T00:37:46,780           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,781           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,781           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,781           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,781           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,781           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-10-23T00:37:46,781           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-10-23T00:37:46,782           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,782           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,782           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,782           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,782           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,783           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,783                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,783                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,783                 directory, all directories are treated like packages.
2024-10-23T00:37:46,783           ********************************************************************************

2024-10-23T00:37:46,783   !!
2024-10-23T00:37:46,784     check.warn(importable)
2024-10-23T00:37:46,784   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-10-23T00:37:46,784   !!

2024-10-23T00:37:46,784           ********************************************************************************
2024-10-23T00:37:46,784           ############################
2024-10-23T00:37:46,784           # Package would be ignored #
2024-10-23T00:37:46,785           ############################
2024-10-23T00:37:46,785           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-10-23T00:37:46,785           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,785           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,785           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-10-23T00:37:46,785           to the `packages` configuration field.

2024-10-23T00:37:46,786           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,786           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,786           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,786           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,786           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,787           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-10-23T00:37:46,787           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-10-23T00:37:46,787           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,787           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,787           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,787           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,788           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,788           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,788                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,788                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,789                 directory, all directories are treated like packages.
2024-10-23T00:37:46,789           ********************************************************************************

2024-10-23T00:37:46,789   !!
2024-10-23T00:37:46,789     check.warn(importable)
2024-10-23T00:37:46,789   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-10-23T00:37:46,789   !!

2024-10-23T00:37:46,790           ********************************************************************************
2024-10-23T00:37:46,790           ############################
2024-10-23T00:37:46,790           # Package would be ignored #
2024-10-23T00:37:46,790           ############################
2024-10-23T00:37:46,790           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-10-23T00:37:46,790           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,790           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,791           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-10-23T00:37:46,791           to the `packages` configuration field.

2024-10-23T00:37:46,791           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,791           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,791           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,792           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,792           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,792           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-10-23T00:37:46,792           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-10-23T00:37:46,792           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,792           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,793           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,793           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,793           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,794           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,794                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,794                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,794                 directory, all directories are treated like packages.
2024-10-23T00:37:46,794           ********************************************************************************

2024-10-23T00:37:46,794   !!
2024-10-23T00:37:46,795     check.warn(importable)
2024-10-23T00:37:46,795   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-10-23T00:37:46,795   !!

2024-10-23T00:37:46,795           ********************************************************************************
2024-10-23T00:37:46,795           ############################
2024-10-23T00:37:46,795           # Package would be ignored #
2024-10-23T00:37:46,796           ############################
2024-10-23T00:37:46,796           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-10-23T00:37:46,796           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,796           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,796           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-10-23T00:37:46,796           to the `packages` configuration field.

2024-10-23T00:37:46,797           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,797           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,797           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,797           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,798           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,798           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-10-23T00:37:46,798           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-10-23T00:37:46,798           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,798           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,798           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,799           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,799           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,799           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,800                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,800                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,800                 directory, all directories are treated like packages.
2024-10-23T00:37:46,800           ********************************************************************************

2024-10-23T00:37:46,800   !!
2024-10-23T00:37:46,800     check.warn(importable)
2024-10-23T00:37:46,800   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-10-23T00:37:46,801   !!

2024-10-23T00:37:46,801           ********************************************************************************
2024-10-23T00:37:46,801           ############################
2024-10-23T00:37:46,801           # Package would be ignored #
2024-10-23T00:37:46,801           ############################
2024-10-23T00:37:46,801           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-10-23T00:37:46,801           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,802           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,802           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-10-23T00:37:46,802           to the `packages` configuration field.

2024-10-23T00:37:46,802           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,802           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,803           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,803           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,803           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,803           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-10-23T00:37:46,804           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-10-23T00:37:46,804           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,804           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,804           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,804           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,804           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,805           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,805                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,805                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,805                 directory, all directories are treated like packages.
2024-10-23T00:37:46,805           ********************************************************************************

2024-10-23T00:37:46,806   !!
2024-10-23T00:37:46,806     check.warn(importable)
2024-10-23T00:37:46,806   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-10-23T00:37:46,806   !!

2024-10-23T00:37:46,806           ********************************************************************************
2024-10-23T00:37:46,807           ############################
2024-10-23T00:37:46,807           # Package would be ignored #
2024-10-23T00:37:46,807           ############################
2024-10-23T00:37:46,807           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-10-23T00:37:46,807           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,807           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,807           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-10-23T00:37:46,808           to the `packages` configuration field.

2024-10-23T00:37:46,808           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,808           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,808           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,808           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,809           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,809           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-10-23T00:37:46,809           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-10-23T00:37:46,809           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,809           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,810           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,810           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,810           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,811           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,811                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,811                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,811                 directory, all directories are treated like packages.
2024-10-23T00:37:46,811           ********************************************************************************

2024-10-23T00:37:46,811   !!
2024-10-23T00:37:46,811     check.warn(importable)
2024-10-23T00:37:46,812   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-10-23T00:37:46,812   !!

2024-10-23T00:37:46,812           ********************************************************************************
2024-10-23T00:37:46,812           ############################
2024-10-23T00:37:46,812           # Package would be ignored #
2024-10-23T00:37:46,812           ############################
2024-10-23T00:37:46,813           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-10-23T00:37:46,813           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,813           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,813           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-10-23T00:37:46,813           to the `packages` configuration field.

2024-10-23T00:37:46,813           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,814           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,814           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,814           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,814           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,815           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-10-23T00:37:46,815           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-10-23T00:37:46,815           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,815           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,815           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,815           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,816           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,816           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,816                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,816                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,816                 directory, all directories are treated like packages.
2024-10-23T00:37:46,817           ********************************************************************************

2024-10-23T00:37:46,817   !!
2024-10-23T00:37:46,817     check.warn(importable)
2024-10-23T00:37:46,817   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-10-23T00:37:46,817   !!

2024-10-23T00:37:46,817           ********************************************************************************
2024-10-23T00:37:46,818           ############################
2024-10-23T00:37:46,818           # Package would be ignored #
2024-10-23T00:37:46,818           ############################
2024-10-23T00:37:46,818           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-10-23T00:37:46,818           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,818           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,819           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-10-23T00:37:46,819           to the `packages` configuration field.

2024-10-23T00:37:46,819           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,819           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,819           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,819           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,820           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,820           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-10-23T00:37:46,820           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-10-23T00:37:46,820           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,821           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,821           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,821           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,821           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,822           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,822                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,822                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,822                 directory, all directories are treated like packages.
2024-10-23T00:37:46,822           ********************************************************************************

2024-10-23T00:37:46,822   !!
2024-10-23T00:37:46,823     check.warn(importable)
2024-10-23T00:37:46,823   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-10-23T00:37:46,823   !!

2024-10-23T00:37:46,823           ********************************************************************************
2024-10-23T00:37:46,823           ############################
2024-10-23T00:37:46,823           # Package would be ignored #
2024-10-23T00:37:46,823           ############################
2024-10-23T00:37:46,824           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-10-23T00:37:46,824           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,824           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,824           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-10-23T00:37:46,824           to the `packages` configuration field.

2024-10-23T00:37:46,825           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,825           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,825           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,825           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,825           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,826           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-10-23T00:37:46,826           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-10-23T00:37:46,826           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,826           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,826           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,826           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,827           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,827           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,827                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,827                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,828                 directory, all directories are treated like packages.
2024-10-23T00:37:46,828           ********************************************************************************

2024-10-23T00:37:46,828   !!
2024-10-23T00:37:46,828     check.warn(importable)
2024-10-23T00:37:46,828   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-10-23T00:37:46,828   !!

2024-10-23T00:37:46,828           ********************************************************************************
2024-10-23T00:37:46,829           ############################
2024-10-23T00:37:46,829           # Package would be ignored #
2024-10-23T00:37:46,829           ############################
2024-10-23T00:37:46,829           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-10-23T00:37:46,829           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,829           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,829           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-10-23T00:37:46,830           to the `packages` configuration field.

2024-10-23T00:37:46,830           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,830           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,830           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,830           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,831           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,831           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-10-23T00:37:46,831           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-10-23T00:37:46,831           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,831           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,831           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,832           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,832           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,832           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,832                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,832                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,833                 directory, all directories are treated like packages.
2024-10-23T00:37:46,833           ********************************************************************************

2024-10-23T00:37:46,833   !!
2024-10-23T00:37:46,833     check.warn(importable)
2024-10-23T00:37:46,833   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-10-23T00:37:46,833   !!

2024-10-23T00:37:46,834           ********************************************************************************
2024-10-23T00:37:46,834           ############################
2024-10-23T00:37:46,834           # Package would be ignored #
2024-10-23T00:37:46,834           ############################
2024-10-23T00:37:46,834           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-10-23T00:37:46,834           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,835           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,835           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-10-23T00:37:46,835           to the `packages` configuration field.

2024-10-23T00:37:46,835           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,835           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,835           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,836           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,836           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,836           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-10-23T00:37:46,836           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-10-23T00:37:46,836           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,836           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,837           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,837           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,837           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,837           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,837                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,838                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,838                 directory, all directories are treated like packages.
2024-10-23T00:37:46,838           ********************************************************************************

2024-10-23T00:37:46,838   !!
2024-10-23T00:37:46,838     check.warn(importable)
2024-10-23T00:37:46,838   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-10-23T00:37:46,839   !!

2024-10-23T00:37:46,839           ********************************************************************************
2024-10-23T00:37:46,839           ############################
2024-10-23T00:37:46,839           # Package would be ignored #
2024-10-23T00:37:46,839           ############################
2024-10-23T00:37:46,839           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-10-23T00:37:46,839           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,840           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,840           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-10-23T00:37:46,840           to the `packages` configuration field.

2024-10-23T00:37:46,840           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,840           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,840           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,841           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,841           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,841           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-10-23T00:37:46,841           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-10-23T00:37:46,841           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,842           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,842           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,842           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,842           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,843           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,843                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,843                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,843                 directory, all directories are treated like packages.
2024-10-23T00:37:46,843           ********************************************************************************

2024-10-23T00:37:46,843   !!
2024-10-23T00:37:46,843     check.warn(importable)
2024-10-23T00:37:46,844   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-10-23T00:37:46,844   !!

2024-10-23T00:37:46,844           ********************************************************************************
2024-10-23T00:37:46,844           ############################
2024-10-23T00:37:46,844           # Package would be ignored #
2024-10-23T00:37:46,844           ############################
2024-10-23T00:37:46,845           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-10-23T00:37:46,845           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,845           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,845           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-10-23T00:37:46,845           to the `packages` configuration field.

2024-10-23T00:37:46,845           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,846           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,846           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,846           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,846           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,847           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-10-23T00:37:46,847           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-10-23T00:37:46,847           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,847           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,847           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,847           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,848           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,848           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,848                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,848                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,848                 directory, all directories are treated like packages.
2024-10-23T00:37:46,849           ********************************************************************************

2024-10-23T00:37:46,849   !!
2024-10-23T00:37:46,849     check.warn(importable)
2024-10-23T00:37:46,849   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-10-23T00:37:46,849   !!

2024-10-23T00:37:46,850           ********************************************************************************
2024-10-23T00:37:46,850           ############################
2024-10-23T00:37:46,850           # Package would be ignored #
2024-10-23T00:37:46,850           ############################
2024-10-23T00:37:46,850           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-10-23T00:37:46,850           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,851           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,851           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-10-23T00:37:46,851           to the `packages` configuration field.

2024-10-23T00:37:46,851           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,851           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,851           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,852           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,852           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,852           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-10-23T00:37:46,853           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-10-23T00:37:46,853           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,853           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,853           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,853           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,853           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,854           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,854                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,854                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,854                 directory, all directories are treated like packages.
2024-10-23T00:37:46,854           ********************************************************************************

2024-10-23T00:37:46,855   !!
2024-10-23T00:37:46,855     check.warn(importable)
2024-10-23T00:37:46,855   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/command/build_py.py:218: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-10-23T00:37:46,855   !!

2024-10-23T00:37:46,855           ********************************************************************************
2024-10-23T00:37:46,855           ############################
2024-10-23T00:37:46,855           # Package would be ignored #
2024-10-23T00:37:46,856           ############################
2024-10-23T00:37:46,856           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-10-23T00:37:46,856           but it is absent from setuptools' `packages` configuration.

2024-10-23T00:37:46,856           This leads to an ambiguous overall configuration. If you want to distribute this
2024-10-23T00:37:46,856           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-10-23T00:37:46,856           to the `packages` configuration field.

2024-10-23T00:37:46,857           Alternatively, you can also rely on setuptools' discovery methods
2024-10-23T00:37:46,857           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-10-23T00:37:46,857           instead of `find_packages(...)`/`find:`).

2024-10-23T00:37:46,857           You can read more about "package discovery" on setuptools documentation page:

2024-10-23T00:37:46,857           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-10-23T00:37:46,858           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-10-23T00:37:46,858           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-10-23T00:37:46,858           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-10-23T00:37:46,858           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-10-23T00:37:46,858           combination with a more fine grained `package-data` configuration.

2024-10-23T00:37:46,859           You can read more about "package data files" on setuptools documentation page:

2024-10-23T00:37:46,859           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-10-23T00:37:46,859           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-10-23T00:37:46,859                 even if it does not contain any `.py` files.
2024-10-23T00:37:46,859                 On the other hand, currently there is no concept of package data
2024-10-23T00:37:46,860                 directory, all directories are treated like packages.
2024-10-23T00:37:46,860           ********************************************************************************

2024-10-23T00:37:46,860   !!
2024-10-23T00:37:46,860     check.warn(importable)
2024-10-23T00:37:46,860   creating build/lib/deepspeed/ops/csrc
2024-10-23T00:37:46,860   creating build/lib/deepspeed/ops/csrc/adagrad
2024-10-23T00:37:46,860   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-10-23T00:37:46,861   creating build/lib/deepspeed/ops/csrc/adam
2024-10-23T00:37:46,861   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-10-23T00:37:46,861   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-10-23T00:37:46,861   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-10-23T00:37:46,862   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-10-23T00:37:46,865   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-10-23T00:37:46,867   creating build/lib/deepspeed/ops/csrc/aio
2024-10-23T00:37:46,868   creating build/lib/deepspeed/ops/csrc/aio/common
2024-10-23T00:37:46,869   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-23T00:37:46,871   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-23T00:37:46,873   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-23T00:37:46,875   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-23T00:37:46,877   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-23T00:37:46,879   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-10-23T00:37:46,882   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,882   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,885   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,887   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,889   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,890   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,893   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,894   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,896   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,899   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,901   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,903   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,906   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,908   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,910   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,912   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,915   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,917   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:46,919   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-10-23T00:37:46,919   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-10-23T00:37:46,921   creating build/lib/deepspeed/ops/csrc/cpu
2024-10-23T00:37:46,922   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-10-23T00:37:46,923   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-10-23T00:37:46,925   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:46,926   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:46,929   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:46,931   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:46,933   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:46,936   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-10-23T00:37:46,936   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-10-23T00:37:46,938   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-10-23T00:37:46,939   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:46,940   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:46,942   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:46,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:46,947   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:46,949   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:46,953   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:46,956   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:46,957   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:46,959   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:46,962   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:46,965   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:46,967   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:46,968   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:46,971   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:46,973   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:46,976   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:46,979   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:46,982   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:46,984   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:46,988   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:46,989   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:46,992   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:46,995   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:46,998   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,002   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,006   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,008   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,010   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-23T00:37:47,011   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-23T00:37:47,013   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-23T00:37:47,016   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-10-23T00:37:47,016   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-10-23T00:37:47,019   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-10-23T00:37:47,022   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-10-23T00:37:47,023   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-10-23T00:37:47,025   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-10-23T00:37:47,027   creating build/lib/deepspeed/ops/csrc/gds
2024-10-23T00:37:47,027   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:47,028   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:47,031   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:47,033   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:47,035   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:47,037   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:47,039   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:47,041   creating build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,042   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,044   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,046   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,048   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,050   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,052   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,055   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,057   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,059   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,062   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,064   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,066   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,069   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,071   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,073   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,075   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,077   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,079   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,082   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,083   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,086   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,089   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,091   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,094   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,096   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,099   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,101   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,103   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,106   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-10-23T00:37:47,108   creating build/lib/deepspeed/ops/csrc/lamb
2024-10-23T00:37:47,109   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-10-23T00:37:47,111   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-10-23T00:37:47,114   creating build/lib/deepspeed/ops/csrc/lion
2024-10-23T00:37:47,115   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-10-23T00:37:47,117   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-10-23T00:37:47,119   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-10-23T00:37:47,121   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-10-23T00:37:47,123   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-10-23T00:37:47,126   creating build/lib/deepspeed/ops/csrc/quantization
2024-10-23T00:37:47,127   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-23T00:37:47,129   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-23T00:37:47,132   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-10-23T00:37:47,135   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-23T00:37:47,137   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-23T00:37:47,139   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-23T00:37:47,142   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-10-23T00:37:47,144   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:47,145   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:47,148   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:47,150   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:47,152   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:47,155   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-10-23T00:37:47,155   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-10-23T00:37:47,158   creating build/lib/deepspeed/ops/csrc/spatial
2024-10-23T00:37:47,158   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-10-23T00:37:47,159   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-10-23T00:37:47,162   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-10-23T00:37:47,164   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-10-23T00:37:47,165   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-10-23T00:37:47,167   creating build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,168   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,171   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,173   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,177   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,179   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,182   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,186   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,189   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-10-23T00:37:47,192   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-10-23T00:37:47,192   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,193   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,196   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,198   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,201   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,204   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,206   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,210   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,213   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,215   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,218   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:47,221   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-10-23T00:37:47,222   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-10-23T00:37:47,225   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-10-23T00:37:47,227   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-10-23T00:37:47,230   creating build/lib/deepspeed/ops/csrc/utils
2024-10-23T00:37:47,231   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-10-23T00:37:47,233   creating build/lib/deepspeed/ops/csrc/xpu
2024-10-23T00:37:47,234   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-10-23T00:37:47,235   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-10-23T00:37:47,237   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-10-23T00:37:47,238   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-10-23T00:37:47,241   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-10-23T00:37:47,243   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-10-23T00:37:47,246   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-10-23T00:37:47,247   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-10-23T00:37:47,249   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:47,250   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:47,253   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:47,255   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:47,257   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:47,260   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:47,263   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-10-23T00:37:47,263   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-10-23T00:37:47,266   creating build/lib/deepspeed/autotuning/config_templates
2024-10-23T00:37:47,266   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-10-23T00:37:47,268   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-10-23T00:37:47,270   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-10-23T00:37:47,272   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-10-23T00:37:47,274   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:47,277   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:47,279   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:47,281   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-10-23T00:37:47,282   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-10-23T00:37:47,284   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-10-23T00:37:47,286   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-10-23T00:37:47,287   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-10-23T00:37:47,289   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:47,290   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:47,292   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:47,295   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:47,297   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:47,300   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:47,303   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-10-23T00:37:47,305   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-10-23T00:37:47,306   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-10-23T00:37:47,308   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-10-23T00:37:47,309   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-10-23T00:37:47,310   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-10-23T00:37:47,312   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-23T00:37:47,313   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-23T00:37:47,315   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-23T00:37:47,317   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-23T00:37:47,319   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-10-23T00:37:47,321   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:47,324   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:47,326   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:47,328   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:47,330   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:47,332   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:47,334   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:47,336   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:47,338   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:47,340   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:47,342   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:47,345   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:47,347   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:47,349   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:47,352   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:47,354   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:47,356   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:47,358   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:47,360   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:47,362   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:47,365   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:47,367   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:47,369   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:47,371   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:47,373   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:47,375   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:47,377   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:47,379   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:47,382   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:47,384   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:47,385   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:47,387   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:47,390   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:47,392   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:47,394   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:47,396   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:47,398   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:47,400   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:47,402   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:47,405   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:47,408   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:47,410   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:47,412   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:47,414   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:47,417   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:47,419   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,420   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,422   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,425   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,427   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,429   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,431   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,434   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,436   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,438   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:47,441   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:47,443   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:47,445   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:47,447   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:47,449   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:47,451   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:47,454   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:47,456   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:47,458   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:47,523   running build_scripts
2024-10-23T00:37:47,523   creating build/scripts-3.9
2024-10-23T00:37:47,524   copying and adjusting bin/deepspeed -> build/scripts-3.9
2024-10-23T00:37:47,526   copying and adjusting bin/deepspeed.pt -> build/scripts-3.9
2024-10-23T00:37:47,527   copying and adjusting bin/ds -> build/scripts-3.9
2024-10-23T00:37:47,529   copying bin/ds_ssh -> build/scripts-3.9
2024-10-23T00:37:47,531   copying and adjusting bin/ds_report -> build/scripts-3.9
2024-10-23T00:37:47,532   copying and adjusting bin/ds_bench -> build/scripts-3.9
2024-10-23T00:37:47,534   copying and adjusting bin/dsr -> build/scripts-3.9
2024-10-23T00:37:47,535   copying and adjusting bin/ds_elastic -> build/scripts-3.9
2024-10-23T00:37:47,537   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.9
2024-10-23T00:37:47,538   copying and adjusting bin/ds_io -> build/scripts-3.9
2024-10-23T00:37:47,539   changing mode of build/scripts-3.9/deepspeed from 644 to 755
2024-10-23T00:37:47,539   changing mode of build/scripts-3.9/deepspeed.pt from 644 to 755
2024-10-23T00:37:47,540   changing mode of build/scripts-3.9/ds from 644 to 755
2024-10-23T00:37:47,540   changing mode of build/scripts-3.9/ds_report from 644 to 755
2024-10-23T00:37:47,541   changing mode of build/scripts-3.9/ds_bench from 644 to 755
2024-10-23T00:37:47,541   changing mode of build/scripts-3.9/dsr from 644 to 755
2024-10-23T00:37:47,541   changing mode of build/scripts-3.9/ds_elastic from 644 to 755
2024-10-23T00:37:47,542   changing mode of build/scripts-3.9/ds_nvme_tune from 644 to 755
2024-10-23T00:37:47,542   changing mode of build/scripts-3.9/ds_io from 644 to 755
2024-10-23T00:37:47,570   /home/piwheels/.local/lib/python3.9/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-10-23T00:37:47,570   !!

2024-10-23T00:37:47,570           ********************************************************************************
2024-10-23T00:37:47,570           Please avoid running ``setup.py`` directly.
2024-10-23T00:37:47,570           Instead, use pypa/build, pypa/installer or other
2024-10-23T00:37:47,571           standards-based tools.

2024-10-23T00:37:47,571           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-10-23T00:37:47,571           ********************************************************************************

2024-10-23T00:37:47,571   !!
2024-10-23T00:37:47,571     self.initialize_options()
2024-10-23T00:37:47,597   installing to build/bdist.linux-armv7l/wheel
2024-10-23T00:37:47,597   running install
2024-10-23T00:37:47,623   running install_lib
2024-10-23T00:37:47,651   creating build/bdist.linux-armv7l
2024-10-23T00:37:47,651   creating build/bdist.linux-armv7l/wheel
2024-10-23T00:37:47,653   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-10-23T00:37:47,654   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-23T00:37:47,657   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-10-23T00:37:47,659   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-10-23T00:37:47,660   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-10-23T00:37:47,662   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-10-23T00:37:47,664   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-10-23T00:37:47,665   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-10-23T00:37:47,667   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-10-23T00:37:47,669   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-10-23T00:37:47,670   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-10-23T00:37:47,672   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-10-23T00:37:47,674   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2024-10-23T00:37:47,675   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2024-10-23T00:37:47,678   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-10-23T00:37:47,678   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-23T00:37:47,680   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-23T00:37:47,684   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:47,685   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:47,687   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:47,689   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:47,690   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-10-23T00:37:47,692   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-23T00:37:47,695   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-23T00:37:47,697   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-23T00:37:47,699   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-23T00:37:47,701   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-10-23T00:37:47,704   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-10-23T00:37:47,705   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-10-23T00:37:47,706   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-10-23T00:37:47,709   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-10-23T00:37:47,710   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-10-23T00:37:47,712   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-10-23T00:37:47,714   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-10-23T00:37:47,715   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-10-23T00:37:47,718   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-10-23T00:37:47,718   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-10-23T00:37:47,721   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-10-23T00:37:47,723   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-10-23T00:37:47,725   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-10-23T00:37:47,726   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-10-23T00:37:47,729   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-10-23T00:37:47,731   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-10-23T00:37:47,733   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,734   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,736   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,737   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,739   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,741   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,743   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,745   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,747   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,749   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,750   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,752   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,754   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,756   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,758   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,760   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,761   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,763   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,765   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,766   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,768   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,770   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,772   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,774   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-10-23T00:37:47,776   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,778   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,781   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,783   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,784   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,787   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,789   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,791   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,793   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,795   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-10-23T00:37:47,797   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,798   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,800   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,802   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,804   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,807   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,808   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,810   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,813   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,815   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,817   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-10-23T00:37:47,819   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-10-23T00:37:47,820   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,822   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,824   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,826   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2024-10-23T00:37:47,827   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-23T00:37:47,828   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-23T00:37:47,830   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-23T00:37:47,832   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-23T00:37:47,834   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-23T00:37:47,835   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-10-23T00:37:47,837   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,839   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,841   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,843   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,845   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,846   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,849   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-10-23T00:37:47,850   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-23T00:37:47,852   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-23T00:37:47,854   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-23T00:37:47,855   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-23T00:37:47,857   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-23T00:37:47,859   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-10-23T00:37:47,861   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,862   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,865   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,867   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,868   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,870   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,872   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,873   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,875   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,877   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,879   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,881   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,883   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-10-23T00:37:47,885   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,887   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,888   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,890   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,892   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,893   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,895   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,897   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,899   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,901   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,902   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,904   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,906   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,907   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,909   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-10-23T00:37:47,911   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,912   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,914   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,916   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,918   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,920   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-10-23T00:37:47,921   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-23T00:37:47,922   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-23T00:37:47,924   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-23T00:37:47,926   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-23T00:37:47,928   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-23T00:37:47,929   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-23T00:37:47,931   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-10-23T00:37:47,932   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,934   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,936   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-10-23T00:37:47,938   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-10-23T00:37:47,939   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-10-23T00:37:47,941   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-10-23T00:37:47,943   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-10-23T00:37:47,944   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-10-23T00:37:47,947   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-10-23T00:37:47,948   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-10-23T00:37:47,950   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:47,951   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:47,954   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,955   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,957   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,961   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,965   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,967   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,969   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,971   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-10-23T00:37:47,974   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:47,975   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:47,978   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:47,980   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:47,982   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:47,986   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:47,988   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:47,991   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-10-23T00:37:47,993   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:47,995   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:48,000   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-23T00:37:48,001   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-23T00:37:48,003   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-10-23T00:37:48,006   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:48,006   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:48,009   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:48,011   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:48,014   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-10-23T00:37:48,017   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:48,019   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:48,022   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-10-23T00:37:48,026   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:48,026   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:48,029   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:48,031   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:48,033   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-10-23T00:37:48,036   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-10-23T00:37:48,037   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,039   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,041   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,043   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,045   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,047   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,048   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,050   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,052   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,055   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,057   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,059   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,061   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,063   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,066   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,068   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,071   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,073   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,075   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,077   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,079   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,081   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,082   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,084   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,087   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,089   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,091   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,094   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,096   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-10-23T00:37:48,099   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-10-23T00:37:48,099   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-10-23T00:37:48,102   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-10-23T00:37:48,103   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-10-23T00:37:48,106   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2024-10-23T00:37:48,107   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:48,108   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:48,111   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:48,112   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:48,114   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:48,117   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:48,119   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-10-23T00:37:48,121   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-10-23T00:37:48,122   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-10-23T00:37:48,125   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-10-23T00:37:48,125   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-23T00:37:48,128   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-23T00:37:48,129   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-23T00:37:48,131   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-23T00:37:48,133   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-10-23T00:37:48,135   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-10-23T00:37:48,137   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-10-23T00:37:48,138   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-10-23T00:37:48,140   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-10-23T00:37:48,142   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-10-23T00:37:48,144   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-10-23T00:37:48,147   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,147   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,151   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,153   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,155   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,158   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,160   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,163   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,165   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-10-23T00:37:48,170   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-10-23T00:37:48,171   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-10-23T00:37:48,172   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-10-23T00:37:48,174   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-10-23T00:37:48,177   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-10-23T00:37:48,179   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,180   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,183   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,187   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,189   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,192   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,194   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,196   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,198   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,201   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,203   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-10-23T00:37:48,206   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-10-23T00:37:48,207   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-23T00:37:48,209   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-23T00:37:48,211   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-23T00:37:48,213   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-23T00:37:48,215   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-10-23T00:37:48,218   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-10-23T00:37:48,219   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:48,220   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:48,222   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:48,224   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:48,226   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:48,228   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-10-23T00:37:48,231   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-10-23T00:37:48,232   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-10-23T00:37:48,235   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-10-23T00:37:48,236   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-10-23T00:37:48,238   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-10-23T00:37:48,239   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-10-23T00:37:48,241   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-10-23T00:37:48,242   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-10-23T00:37:48,245   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-10-23T00:37:48,246   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-10-23T00:37:48,249   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-10-23T00:37:48,250   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-10-23T00:37:48,251   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-10-23T00:37:48,254   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,255   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,257   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,259   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,260   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,262   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,264   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,266   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,267   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,269   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,271   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,273   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,275   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,277   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,278   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,280   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,283   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,284   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-10-23T00:37:48,287   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-10-23T00:37:48,287   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-23T00:37:48,289   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-23T00:37:48,291   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-23T00:37:48,293   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-23T00:37:48,296   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-23T00:37:48,298   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-10-23T00:37:48,300   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-10-23T00:37:48,301   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-10-23T00:37:48,303   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-10-23T00:37:48,305   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-10-23T00:37:48,307   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-10-23T00:37:48,308   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-10-23T00:37:48,310   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-10-23T00:37:48,311   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-10-23T00:37:48,313   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-10-23T00:37:48,315   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-10-23T00:37:48,317   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:48,318   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:48,320   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:48,323   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:48,325   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-10-23T00:37:48,327   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-10-23T00:37:48,328   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-10-23T00:37:48,330   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-10-23T00:37:48,331   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-10-23T00:37:48,334   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-10-23T00:37:48,335   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-23T00:37:48,337   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-23T00:37:48,339   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-23T00:37:48,341   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-23T00:37:48,343   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-23T00:37:48,346   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-23T00:37:48,348   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-10-23T00:37:48,351   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-10-23T00:37:48,352   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-10-23T00:37:48,354   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-10-23T00:37:48,355   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-10-23T00:37:48,358   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-10-23T00:37:48,359   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-10-23T00:37:48,362   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-10-23T00:37:48,362   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,364   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,366   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,368   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,370   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,372   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,374   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,375   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,377   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-10-23T00:37:48,380   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-10-23T00:37:48,381   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-10-23T00:37:48,383   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-10-23T00:37:48,384   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-23T00:37:48,386   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-23T00:37:48,388   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-23T00:37:48,390   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-23T00:37:48,392   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-10-23T00:37:48,394   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-10-23T00:37:48,395   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,397   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,399   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,401   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,404   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,406   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,408   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,411   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,414   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-10-23T00:37:48,414   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,417   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,418   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,420   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,422   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,424   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,426   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,429   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,430   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,433   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,435   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,436   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,439   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,441   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,443   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-10-23T00:37:48,444   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-23T00:37:48,447   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-23T00:37:48,448   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-23T00:37:48,450   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-23T00:37:48,452   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-23T00:37:48,454   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-23T00:37:48,456   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-10-23T00:37:48,458   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,460   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,462   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,464   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,466   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-10-23T00:37:48,468   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,470   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,472   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,474   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,475   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-10-23T00:37:48,478   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-10-23T00:37:48,479   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,482   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-10-23T00:37:48,483   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,486   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,488   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,490   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,492   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,494   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,496   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,498   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,502   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,504   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,509   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,510   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,514   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,516   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,518   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,520   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,522   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-10-23T00:37:48,526   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-10-23T00:37:48,526   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-23T00:37:48,529   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-23T00:37:48,531   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-23T00:37:48,533   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-23T00:37:48,535   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-23T00:37:48,537   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-10-23T00:37:48,539   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-10-23T00:37:48,540   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:48,541   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:48,544   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:48,546   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:48,549   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:48,551   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-10-23T00:37:48,553   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-10-23T00:37:48,555   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-10-23T00:37:48,558   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-10-23T00:37:48,560   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-10-23T00:37:48,562   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:48,562   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:48,564   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:48,566   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:48,568   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:48,570   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-10-23T00:37:48,572   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-10-23T00:37:48,573   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-23T00:37:48,576   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-23T00:37:48,579   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-23T00:37:48,582   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-23T00:37:48,584   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-23T00:37:48,586   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-10-23T00:37:48,589   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:48,590   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:48,591   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:48,593   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:48,595   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-10-23T00:37:48,597   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,599   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,601   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,604   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,606   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,609   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,611   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,613   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,617   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-10-23T00:37:48,618   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-10-23T00:37:48,621   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-10-23T00:37:48,622   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-10-23T00:37:48,625   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,626   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,627   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,630   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,631   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,633   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,636   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,638   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,640   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,643   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-10-23T00:37:48,645   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-10-23T00:37:48,646   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-10-23T00:37:48,648   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-10-23T00:37:48,650   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,651   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,657   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,659   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,662   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-10-23T00:37:48,663   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-10-23T00:37:48,664   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-10-23T00:37:48,666   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-10-23T00:37:48,668   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-10-23T00:37:48,671   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-10-23T00:37:48,673   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-10-23T00:37:48,676   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-10-23T00:37:48,678   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-10-23T00:37:48,680   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-10-23T00:37:48,682   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,685   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,687   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,689   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,690   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-10-23T00:37:48,693   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-23T00:37:48,695   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-10-23T00:37:48,696   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-10-23T00:37:48,697   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-10-23T00:37:48,699   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-10-23T00:37:48,702   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-10-23T00:37:48,704   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-10-23T00:37:48,705   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-10-23T00:37:48,708   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-10-23T00:37:48,708   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,710   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,712   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,714   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,716   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,718   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,720   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,723   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,725   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,727   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,729   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,731   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,732   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,735   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,737   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,739   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,741   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,743   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-10-23T00:37:48,745   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-10-23T00:37:48,746   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,749   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,751   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,753   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,755   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,757   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,759   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,761   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,763   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,765   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-10-23T00:37:48,767   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-10-23T00:37:48,768   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-10-23T00:37:48,770   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-10-23T00:37:48,772   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-10-23T00:37:48,774   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-10-23T00:37:48,775   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-23T00:37:48,778   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-23T00:37:48,779   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-23T00:37:48,782   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-23T00:37:48,784   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-23T00:37:48,786   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-10-23T00:37:48,788   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-23T00:37:48,790   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-10-23T00:37:48,791   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-10-23T00:37:48,793   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-10-23T00:37:48,795   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-10-23T00:37:48,798   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-10-23T00:37:48,798   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-23T00:37:48,806   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-23T00:37:48,809   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-23T00:37:48,811   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-23T00:37:48,813   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-23T00:37:48,816   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-10-23T00:37:48,817   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-10-23T00:37:48,819   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-10-23T00:37:48,820   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-10-23T00:37:48,822   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-10-23T00:37:48,823   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-10-23T00:37:48,826   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-10-23T00:37:48,827   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-23T00:37:48,829   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-23T00:37:48,830   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-23T00:37:48,832   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-23T00:37:48,834   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-23T00:37:48,836   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-10-23T00:37:48,838   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-10-23T00:37:48,839   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-23T00:37:48,841   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-23T00:37:48,844   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-23T00:37:48,846   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-23T00:37:48,849   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-23T00:37:48,851   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-23T00:37:48,853   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-23T00:37:48,856   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-10-23T00:37:48,857   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-23T00:37:48,859   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-10-23T00:37:48,861   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-10-23T00:37:48,862   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,864   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,866   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,867   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,869   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,871   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,873   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,874   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,876   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,878   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-10-23T00:37:48,880   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-10-23T00:37:48,881   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-10-23T00:37:48,883   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-10-23T00:37:48,884   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-10-23T00:37:48,886   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-10-23T00:37:48,887   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-10-23T00:37:48,889   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-10-23T00:37:48,892   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-10-23T00:37:48,894   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-10-23T00:37:48,895   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-23T00:37:48,897   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-23T00:37:48,898   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-23T00:37:48,900   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-23T00:37:48,902   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-23T00:37:48,904   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-23T00:37:48,906   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-23T00:37:48,908   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-10-23T00:37:48,910   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2024-10-23T00:37:48,911   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,913   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,915   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,917   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,919   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,920   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,922   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,924   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,926   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,927   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,929   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,931   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-10-23T00:37:48,933   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-10-23T00:37:48,936   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-10-23T00:37:48,937   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-23T00:37:48,939   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-23T00:37:48,941   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-23T00:37:48,943   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-23T00:37:48,945   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-23T00:37:48,947   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-10-23T00:37:48,949   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-10-23T00:37:48,950   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,952   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,954   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,957   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,959   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,961   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,963   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,966   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,967   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,970   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-10-23T00:37:48,972   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-10-23T00:37:48,973   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-10-23T00:37:48,976   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-10-23T00:37:48,978   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-10-23T00:37:48,980   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-10-23T00:37:48,981   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-23T00:37:48,983   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-23T00:37:48,985   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-23T00:37:48,987   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-23T00:37:48,989   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-10-23T00:37:48,991   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-10-23T00:37:48,992   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:48,995   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-10-23T00:37:48,996   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-10-23T00:37:48,997   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-10-23T00:37:48,999   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-23T00:37:49,001   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-10-23T00:37:49,002   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-10-23T00:37:49,004   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-10-23T00:37:49,006   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-23T00:37:49,008   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-23T00:37:49,010   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-23T00:37:49,012   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-23T00:37:49,014   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-23T00:37:49,016   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-10-23T00:37:49,019   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:49,023   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-10-23T00:37:49,024   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-10-23T00:37:49,026   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-10-23T00:37:49,028   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-10-23T00:37:49,031   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-10-23T00:37:49,033   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:49,036   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:49,038   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:49,040   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:49,043   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-10-23T00:37:49,045   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-23T00:37:49,048   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-23T00:37:49,052   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,053   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,056   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,059   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,061   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,064   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,066   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,069   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,071   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,073   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-10-23T00:37:49,076   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:49,077   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:49,080   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:49,083   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:49,085   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-10-23T00:37:49,088   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:49,089   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:49,092   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:49,094   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:49,096   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-10-23T00:37:49,099   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:49,100   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:49,103   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:49,106   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:49,108   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-10-23T00:37:49,111   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:49,112   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:49,115   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:49,117   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:49,119   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-10-23T00:37:49,121   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:49,121   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:49,124   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:49,125   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:49,127   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-10-23T00:37:49,129   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:49,130   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:49,132   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:49,134   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:49,136   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-10-23T00:37:49,138   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:49,139   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:49,141   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:49,142   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:49,144   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-10-23T00:37:49,146   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:49,147   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:49,149   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:49,151   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:49,153   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-10-23T00:37:49,154   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-23T00:37:49,157   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,158   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,160   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,162   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,163   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,165   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,167   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,169   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,170   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,172   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-10-23T00:37:49,174   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-23T00:37:49,176   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:49,177   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:49,179   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:49,181   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:49,183   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-10-23T00:37:49,185   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-23T00:37:49,187   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-23T00:37:49,189   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:49,190   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:49,193   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:49,194   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:49,196   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-10-23T00:37:49,198   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-10-23T00:37:49,200   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:49,202   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:49,204   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-10-23T00:37:49,206   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:49,206   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:49,208   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:49,211   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:49,214   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:49,216   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-10-23T00:37:49,218   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-10-23T00:37:49,220   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-10-23T00:37:49,221   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:49,222   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:49,224   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:49,226   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:49,228   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:49,230   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:49,232   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-10-23T00:37:49,234   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-10-23T00:37:49,235   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-10-23T00:37:49,237   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:49,238   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:49,240   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:49,242   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:49,244   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:49,246   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-10-23T00:37:49,247   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-10-23T00:37:49,249   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-10-23T00:37:49,251   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-10-23T00:37:49,252   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:49,253   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:49,255   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:49,257   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:49,259   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:49,260   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:49,262   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-10-23T00:37:49,264   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,265   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,268   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,269   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,271   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,273   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,275   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,276   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,278   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-10-23T00:37:49,280   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:49,282   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:49,284   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:49,286   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:49,287   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-10-23T00:37:49,289   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-10-23T00:37:49,290   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-10-23T00:37:49,292   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:49,293   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:49,295   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:49,297   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:49,299   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:49,300   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:49,302   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-10-23T00:37:49,304   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:49,305   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:49,307   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:49,309   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:49,310   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:49,313   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:49,314   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-10-23T00:37:49,316   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-10-23T00:37:49,318   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-23T00:37:49,319   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-23T00:37:49,321   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-23T00:37:49,322   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-10-23T00:37:49,324   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:49,325   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:49,327   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:49,329   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:49,331   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:49,332   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:49,334   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-10-23T00:37:49,336   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-10-23T00:37:49,338   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:49,339   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:49,340   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:49,342   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:49,344   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:49,345   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:49,347   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-10-23T00:37:49,349   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:49,350   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:49,352   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:49,354   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:49,355   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:49,357   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:49,359   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-10-23T00:37:49,361   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-10-23T00:37:49,363   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-10-23T00:37:49,364   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,365   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,367   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,369   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,370   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,372   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,374   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,376   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,377   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-10-23T00:37:49,380   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:49,381   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:49,383   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:49,385   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:49,387   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-10-23T00:37:49,389   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:49,390   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:49,393   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:49,394   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:49,397   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:49,398   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:49,401   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-10-23T00:37:49,403   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,404   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,406   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,408   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,410   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,412   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,414   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,416   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,418   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,420   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-10-23T00:37:49,423   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:49,423   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:49,426   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:49,427   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:49,429   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:49,431   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-10-23T00:37:49,433   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:49,434   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:49,436   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:49,438   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:49,440   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:49,442   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:49,443   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:49,445   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-10-23T00:37:49,447   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-10-23T00:37:49,449   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-10-23T00:37:49,451   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:49,452   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:49,454   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:49,456   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:49,458   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:49,460   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-10-23T00:37:49,462   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-10-23T00:37:49,463   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-10-23T00:37:49,465   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-10-23T00:37:49,466   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-10-23T00:37:49,468   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-10-23T00:37:49,470   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-10-23T00:37:49,472   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-10-23T00:37:49,473   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-10-23T00:37:49,475   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-10-23T00:37:49,477   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-10-23T00:37:49,478   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-10-23T00:37:49,480   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-10-23T00:37:49,482   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-10-23T00:37:49,482   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-10-23T00:37:49,484   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-10-23T00:37:49,487   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-23T00:37:49,488   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-23T00:37:49,489   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-23T00:37:49,491   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-10-23T00:37:49,493   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-10-23T00:37:49,495   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-10-23T00:37:49,495   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-10-23T00:37:49,498   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-10-23T00:37:49,500   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-10-23T00:37:49,501   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-10-23T00:37:49,503   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-10-23T00:37:49,505   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-10-23T00:37:49,506   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-23T00:37:49,508   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-23T00:37:49,510   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-23T00:37:49,511   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-23T00:37:49,513   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-23T00:37:49,515   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-23T00:37:49,516   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-10-23T00:37:49,518   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-10-23T00:37:49,519   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-10-23T00:37:49,522   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,523   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,525   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,526   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,528   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,530   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,531   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,534   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,535   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-10-23T00:37:49,537   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-10-23T00:37:49,539   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-10-23T00:37:49,540   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-10-23T00:37:49,542   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-10-23T00:37:49,543   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-23T00:37:49,545   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-23T00:37:49,547   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-23T00:37:49,549   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-23T00:37:49,550   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-23T00:37:49,553   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-10-23T00:37:49,554   running install_egg_info
2024-10-23T00:37:49,588   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.15.3-py3.9.egg-info
2024-10-23T00:37:49,602   running install_scripts
2024-10-23T00:37:49,603   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data
2024-10-23T00:37:49,603   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,604   copying build/scripts-3.9/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,606   copying build/scripts-3.9/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,607   copying build/scripts-3.9/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,609   copying build/scripts-3.9/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,611   copying build/scripts-3.9/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,612   copying build/scripts-3.9/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,614   copying build/scripts-3.9/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,615   copying build/scripts-3.9/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,617   copying build/scripts-3.9/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,619   copying build/scripts-3.9/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts
2024-10-23T00:37:49,620   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/ds to 755
2024-10-23T00:37:49,620   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/ds_bench to 755
2024-10-23T00:37:49,621   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/ds_report to 755
2024-10-23T00:37:49,621   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/ds_io to 755
2024-10-23T00:37:49,621   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/ds_ssh to 755
2024-10-23T00:37:49,622   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/deepspeed.pt to 755
2024-10-23T00:37:49,622   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/ds_nvme_tune to 755
2024-10-23T00:37:49,622   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/dsr to 755
2024-10-23T00:37:49,623   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/deepspeed to 755
2024-10-23T00:37:49,623   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.data/scripts/ds_elastic to 755
2024-10-23T00:37:49,683   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.3.dist-info/WHEEL
2024-10-23T00:37:49,686   creating '/tmp/pip-wheel-w49tgtph/deepspeed-0.15.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-10-23T00:37:49,689   adding 'deepspeed/__init__.py'
2024-10-23T00:37:49,691   adding 'deepspeed/constants.py'
2024-10-23T00:37:49,692   adding 'deepspeed/env_report.py'
2024-10-23T00:37:49,693   adding 'deepspeed/git_version_info.py'
2024-10-23T00:37:49,695   adding 'deepspeed/git_version_info_installed.py'
2024-10-23T00:37:49,697   adding 'deepspeed/accelerator/__init__.py'
2024-10-23T00:37:49,698   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-10-23T00:37:49,700   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-10-23T00:37:49,702   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-10-23T00:37:49,704   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-10-23T00:37:49,706   adding 'deepspeed/accelerator/mlu_accelerator.py'
2024-10-23T00:37:49,707   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-10-23T00:37:49,709   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-10-23T00:37:49,711   adding 'deepspeed/accelerator/real_accelerator.py'
2024-10-23T00:37:49,713   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-10-23T00:37:49,715   adding 'deepspeed/autotuning/__init__.py'
2024-10-23T00:37:49,720   adding 'deepspeed/autotuning/autotuner.py'
2024-10-23T00:37:49,721   adding 'deepspeed/autotuning/config.py'
2024-10-23T00:37:49,723   adding 'deepspeed/autotuning/constants.py'
2024-10-23T00:37:49,725   adding 'deepspeed/autotuning/scheduler.py'
2024-10-23T00:37:49,728   adding 'deepspeed/autotuning/utils.py'
2024-10-23T00:37:49,730   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-10-23T00:37:49,731   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-10-23T00:37:49,732   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-10-23T00:37:49,733   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-10-23T00:37:49,735   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-10-23T00:37:49,736   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-10-23T00:37:49,738   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-10-23T00:37:49,739   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-10-23T00:37:49,740   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-10-23T00:37:49,742   adding 'deepspeed/autotuning/tuner/utils.py'
2024-10-23T00:37:49,743   adding 'deepspeed/checkpoint/__init__.py'
2024-10-23T00:37:49,745   adding 'deepspeed/checkpoint/constants.py'
2024-10-23T00:37:49,747   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-10-23T00:37:49,750   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-10-23T00:37:49,752   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-10-23T00:37:49,754   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-10-23T00:37:49,755   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-10-23T00:37:49,757   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-10-23T00:37:49,758   adding 'deepspeed/checkpoint/utils.py'
2024-10-23T00:37:49,759   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-10-23T00:37:49,761   adding 'deepspeed/comm/__init__.py'
2024-10-23T00:37:49,762   adding 'deepspeed/comm/backend.py'
2024-10-23T00:37:49,764   adding 'deepspeed/comm/ccl.py'
2024-10-23T00:37:49,767   adding 'deepspeed/comm/comm.py'
2024-10-23T00:37:49,769   adding 'deepspeed/comm/config.py'
2024-10-23T00:37:49,770   adding 'deepspeed/comm/constants.py'
2024-10-23T00:37:49,771   adding 'deepspeed/comm/reduce_op.py'
2024-10-23T00:37:49,773   adding 'deepspeed/comm/torch.py'
2024-10-23T00:37:49,775   adding 'deepspeed/comm/utils.py'
2024-10-23T00:37:49,776   adding 'deepspeed/compression/__init__.py'
2024-10-23T00:37:49,780   adding 'deepspeed/compression/basic_layer.py'
2024-10-23T00:37:49,782   adding 'deepspeed/compression/compress.py'
2024-10-23T00:37:49,784   adding 'deepspeed/compression/config.py'
2024-10-23T00:37:49,786   adding 'deepspeed/compression/constants.py'
2024-10-23T00:37:49,788   adding 'deepspeed/compression/helper.py'
2024-10-23T00:37:49,789   adding 'deepspeed/compression/scheduler.py'
2024-10-23T00:37:49,791   adding 'deepspeed/compression/utils.py'
2024-10-23T00:37:49,793   adding 'deepspeed/elasticity/__init__.py'
2024-10-23T00:37:49,795   adding 'deepspeed/elasticity/config.py'
2024-10-23T00:37:49,796   adding 'deepspeed/elasticity/constants.py'
2024-10-23T00:37:49,798   adding 'deepspeed/elasticity/elastic_agent.py'
2024-10-23T00:37:49,800   adding 'deepspeed/elasticity/elasticity.py'
2024-10-23T00:37:49,801   adding 'deepspeed/elasticity/utils.py'
2024-10-23T00:37:49,803   adding 'deepspeed/inference/__init__.py'
2024-10-23T00:37:49,805   adding 'deepspeed/inference/config.py'
2024-10-23T00:37:49,809   adding 'deepspeed/inference/engine.py'
2024-10-23T00:37:49,811   adding 'deepspeed/inference/quantization/__init__.py'
2024-10-23T00:37:49,812   adding 'deepspeed/inference/quantization/layers.py'
2024-10-23T00:37:49,814   adding 'deepspeed/inference/quantization/quantization.py'
2024-10-23T00:37:49,815   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-10-23T00:37:49,817   adding 'deepspeed/inference/quantization/utils.py'
2024-10-23T00:37:49,819   adding 'deepspeed/inference/v2/__init__.py'
2024-10-23T00:37:49,820   adding 'deepspeed/inference/v2/allocator.py'
2024-10-23T00:37:49,821   adding 'deepspeed/inference/v2/config_v2.py'
2024-10-23T00:37:49,823   adding 'deepspeed/inference/v2/engine_factory.py'
2024-10-23T00:37:49,825   adding 'deepspeed/inference/v2/engine_v2.py'
2024-10-23T00:37:49,826   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-10-23T00:37:49,827   adding 'deepspeed/inference/v2/inference_utils.py'
2024-10-23T00:37:49,829   adding 'deepspeed/inference/v2/logging.py'
2024-10-23T00:37:49,830   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-10-23T00:37:49,831   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-10-23T00:37:49,833   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-10-23T00:37:49,834   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-10-23T00:37:49,835   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-10-23T00:37:49,837   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-10-23T00:37:49,838   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-10-23T00:37:49,840   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-10-23T00:37:49,841   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-10-23T00:37:49,843   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-10-23T00:37:49,844   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-10-23T00:37:49,846   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-10-23T00:37:49,847   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-10-23T00:37:49,848   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-10-23T00:37:49,850   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-10-23T00:37:49,852   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-10-23T00:37:49,853   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-10-23T00:37:49,855   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-10-23T00:37:49,857   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-10-23T00:37:49,858   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-10-23T00:37:49,859   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-10-23T00:37:49,860   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-10-23T00:37:49,862   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-10-23T00:37:49,863   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-10-23T00:37:49,864   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-10-23T00:37:49,866   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-10-23T00:37:49,868   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-10-23T00:37:49,870   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-10-23T00:37:49,872   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-10-23T00:37:49,873   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-10-23T00:37:49,875   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-10-23T00:37:49,876   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-10-23T00:37:49,878   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-10-23T00:37:49,880   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-10-23T00:37:49,882   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-10-23T00:37:49,883   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-10-23T00:37:49,885   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-10-23T00:37:49,886   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-10-23T00:37:49,888   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-10-23T00:37:49,889   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-10-23T00:37:49,891   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-10-23T00:37:49,893   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-10-23T00:37:49,895   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-10-23T00:37:49,896   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-10-23T00:37:49,897   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-10-23T00:37:49,898   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-10-23T00:37:49,900   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-10-23T00:37:49,901   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-10-23T00:37:49,903   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-10-23T00:37:49,904   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-10-23T00:37:49,906   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-10-23T00:37:49,907   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-10-23T00:37:49,909   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-10-23T00:37:49,910   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-10-23T00:37:49,911   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-10-23T00:37:49,913   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-10-23T00:37:49,915   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-10-23T00:37:49,916   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-10-23T00:37:49,917   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-10-23T00:37:49,918   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-10-23T00:37:49,920   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-10-23T00:37:49,921   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-10-23T00:37:49,923   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-10-23T00:37:49,924   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-10-23T00:37:49,926   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-10-23T00:37:49,927   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-10-23T00:37:49,929   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-10-23T00:37:49,930   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-10-23T00:37:49,932   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-10-23T00:37:49,933   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-10-23T00:37:49,936   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-10-23T00:37:49,938   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-10-23T00:37:49,940   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-10-23T00:37:49,942   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-10-23T00:37:49,943   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-10-23T00:37:49,945   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-10-23T00:37:49,946   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-10-23T00:37:49,947   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-10-23T00:37:49,949   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-10-23T00:37:49,950   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-10-23T00:37:49,952   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-10-23T00:37:49,953   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-10-23T00:37:49,955   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-10-23T00:37:49,956   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-10-23T00:37:49,958   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-10-23T00:37:49,959   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-10-23T00:37:49,960   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-10-23T00:37:49,962   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-10-23T00:37:49,963   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-10-23T00:37:49,965   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-10-23T00:37:49,966   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-10-23T00:37:49,968   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-10-23T00:37:49,970   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-10-23T00:37:49,971   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-10-23T00:37:49,972   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-10-23T00:37:49,974   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-10-23T00:37:49,976   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-10-23T00:37:49,977   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-10-23T00:37:49,979   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-10-23T00:37:49,980   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-10-23T00:37:49,982   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-10-23T00:37:49,983   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-10-23T00:37:49,984   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-10-23T00:37:49,986   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-10-23T00:37:49,987   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-10-23T00:37:49,989   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-10-23T00:37:49,990   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-10-23T00:37:49,991   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-10-23T00:37:49,992   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-10-23T00:37:49,994   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-10-23T00:37:49,995   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-10-23T00:37:49,997   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-10-23T00:37:49,999   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-10-23T00:37:50,000   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-10-23T00:37:50,001   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-10-23T00:37:50,002   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-10-23T00:37:50,004   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-10-23T00:37:50,006   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-10-23T00:37:50,007   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-10-23T00:37:50,009   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-10-23T00:37:50,010   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-10-23T00:37:50,012   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-10-23T00:37:50,013   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-10-23T00:37:50,014   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-10-23T00:37:50,016   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-10-23T00:37:50,017   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-10-23T00:37:50,019   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-10-23T00:37:50,021   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-10-23T00:37:50,023   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-10-23T00:37:50,025   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-10-23T00:37:50,027   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-10-23T00:37:50,030   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-10-23T00:37:50,032   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-10-23T00:37:50,033   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-10-23T00:37:50,035   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-10-23T00:37:50,036   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-10-23T00:37:50,037   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-10-23T00:37:50,039   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-10-23T00:37:50,040   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-10-23T00:37:50,041   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-10-23T00:37:50,043   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-10-23T00:37:50,044   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-10-23T00:37:50,046   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-10-23T00:37:50,047   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-10-23T00:37:50,049   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-10-23T00:37:50,050   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-10-23T00:37:50,052   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-10-23T00:37:50,053   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-10-23T00:37:50,055   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-10-23T00:37:50,056   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-10-23T00:37:50,058   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-10-23T00:37:50,059   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-10-23T00:37:50,061   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-10-23T00:37:50,062   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-10-23T00:37:50,064   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-10-23T00:37:50,065   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-10-23T00:37:50,067   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-10-23T00:37:50,068   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-10-23T00:37:50,070   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-10-23T00:37:50,071   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-10-23T00:37:50,073   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-10-23T00:37:50,074   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-10-23T00:37:50,076   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-10-23T00:37:50,077   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-10-23T00:37:50,079   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-10-23T00:37:50,080   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-10-23T00:37:50,082   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-10-23T00:37:50,083   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-10-23T00:37:50,085   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-10-23T00:37:50,086   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-10-23T00:37:50,088   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-10-23T00:37:50,089   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-10-23T00:37:50,091   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-10-23T00:37:50,092   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-10-23T00:37:50,094   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-10-23T00:37:50,095   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-10-23T00:37:50,097   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-10-23T00:37:50,098   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-10-23T00:37:50,100   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-10-23T00:37:50,101   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-10-23T00:37:50,103   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-10-23T00:37:50,105   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-10-23T00:37:50,107   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-10-23T00:37:50,108   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-10-23T00:37:50,109   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-10-23T00:37:50,111   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-10-23T00:37:50,112   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-10-23T00:37:50,114   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-10-23T00:37:50,115   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-10-23T00:37:50,116   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-10-23T00:37:50,118   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-10-23T00:37:50,119   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-10-23T00:37:50,121   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-10-23T00:37:50,122   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-10-23T00:37:50,124   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-10-23T00:37:50,125   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-10-23T00:37:50,127   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-10-23T00:37:50,128   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-10-23T00:37:50,129   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-10-23T00:37:50,131   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-10-23T00:37:50,132   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-10-23T00:37:50,133   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-10-23T00:37:50,135   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-10-23T00:37:50,137   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-10-23T00:37:50,138   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-10-23T00:37:50,140   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-10-23T00:37:50,141   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-10-23T00:37:50,143   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-10-23T00:37:50,144   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-10-23T00:37:50,146   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-10-23T00:37:50,148   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-10-23T00:37:50,150   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-10-23T00:37:50,151   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-10-23T00:37:50,153   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-10-23T00:37:50,154   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-10-23T00:37:50,156   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-10-23T00:37:50,157   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-10-23T00:37:50,159   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-10-23T00:37:50,160   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-10-23T00:37:50,162   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-10-23T00:37:50,164   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-10-23T00:37:50,165   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-10-23T00:37:50,166   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-10-23T00:37:50,168   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-10-23T00:37:50,169   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-10-23T00:37:50,170   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-10-23T00:37:50,172   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-10-23T00:37:50,174   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-10-23T00:37:50,175   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-10-23T00:37:50,177   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-10-23T00:37:50,178   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-10-23T00:37:50,180   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-10-23T00:37:50,182   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-10-23T00:37:50,184   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-10-23T00:37:50,186   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-10-23T00:37:50,188   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-10-23T00:37:50,189   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-10-23T00:37:50,191   adding 'deepspeed/launcher/__init__.py'
2024-10-23T00:37:50,192   adding 'deepspeed/launcher/constants.py'
2024-10-23T00:37:50,194   adding 'deepspeed/launcher/launch.py'
2024-10-23T00:37:50,196   adding 'deepspeed/launcher/launcher_helper.py'
2024-10-23T00:37:50,198   adding 'deepspeed/launcher/multinode_runner.py'
2024-10-23T00:37:50,201   adding 'deepspeed/launcher/runner.py'
2024-10-23T00:37:50,204   adding 'deepspeed/linear/__init__.py'
2024-10-23T00:37:50,205   adding 'deepspeed/linear/config.py'
2024-10-23T00:37:50,206   adding 'deepspeed/linear/context_manager.py'
2024-10-23T00:37:50,208   adding 'deepspeed/linear/optimized_linear.py'
2024-10-23T00:37:50,210   adding 'deepspeed/linear/quantization.py'
2024-10-23T00:37:50,211   adding 'deepspeed/model_implementations/__init__.py'
2024-10-23T00:37:50,213   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-10-23T00:37:50,215   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-10-23T00:37:50,216   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-10-23T00:37:50,218   adding 'deepspeed/model_implementations/features/__init__.py'
2024-10-23T00:37:50,219   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-10-23T00:37:50,221   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-10-23T00:37:50,222   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-10-23T00:37:50,223   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-10-23T00:37:50,224   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-10-23T00:37:50,226   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-10-23T00:37:50,227   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-10-23T00:37:50,228   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-10-23T00:37:50,229   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-10-23T00:37:50,230   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-10-23T00:37:50,232   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-10-23T00:37:50,234   adding 'deepspeed/module_inject/__init__.py'
2024-10-23T00:37:50,237   adding 'deepspeed/module_inject/auto_tp.py'
2024-10-23T00:37:50,239   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-10-23T00:37:50,240   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-10-23T00:37:50,242   adding 'deepspeed/module_inject/inject.py'
2024-10-23T00:37:50,244   adding 'deepspeed/module_inject/layers.py'
2024-10-23T00:37:50,246   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-10-23T00:37:50,247   adding 'deepspeed/module_inject/module_quantize.py'
2024-10-23T00:37:50,249   adding 'deepspeed/module_inject/policy.py'
2024-10-23T00:37:50,253   adding 'deepspeed/module_inject/replace_module.py'
2024-10-23T00:37:50,254   adding 'deepspeed/module_inject/replace_policy.py'
2024-10-23T00:37:50,256   adding 'deepspeed/module_inject/tp_shard.py'
2024-10-23T00:37:50,257   adding 'deepspeed/module_inject/utils.py'
2024-10-23T00:37:50,259   adding 'deepspeed/module_inject/containers/__init__.py'
2024-10-23T00:37:50,261   adding 'deepspeed/module_inject/containers/base.py'
2024-10-23T00:37:50,262   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-10-23T00:37:50,264   adding 'deepspeed/module_inject/containers/bert.py'
2024-10-23T00:37:50,265   adding 'deepspeed/module_inject/containers/bloom.py'
2024-10-23T00:37:50,267   adding 'deepspeed/module_inject/containers/clip.py'
2024-10-23T00:37:50,268   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-10-23T00:37:50,269   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-10-23T00:37:50,271   adding 'deepspeed/module_inject/containers/gptj.py'
2024-10-23T00:37:50,272   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-10-23T00:37:50,274   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-10-23T00:37:50,275   adding 'deepspeed/module_inject/containers/internlm.py'
2024-10-23T00:37:50,277   adding 'deepspeed/module_inject/containers/llama.py'
2024-10-23T00:37:50,279   adding 'deepspeed/module_inject/containers/llama2.py'
2024-10-23T00:37:50,280   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-10-23T00:37:50,281   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-10-23T00:37:50,283   adding 'deepspeed/module_inject/containers/opt.py'
2024-10-23T00:37:50,284   adding 'deepspeed/module_inject/containers/unet.py'
2024-10-23T00:37:50,285   adding 'deepspeed/module_inject/containers/vae.py'
2024-10-23T00:37:50,287   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-10-23T00:37:50,289   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-10-23T00:37:50,290   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-10-23T00:37:50,292   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-10-23T00:37:50,293   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-10-23T00:37:50,295   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-10-23T00:37:50,296   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-10-23T00:37:50,298   adding 'deepspeed/moe/__init__.py'
2024-10-23T00:37:50,299   adding 'deepspeed/moe/experts.py'
2024-10-23T00:37:50,301   adding 'deepspeed/moe/layer.py'
2024-10-23T00:37:50,302   adding 'deepspeed/moe/mappings.py'
2024-10-23T00:37:50,306   adding 'deepspeed/moe/sharded_moe.py'
2024-10-23T00:37:50,307   adding 'deepspeed/moe/utils.py'
2024-10-23T00:37:50,309   adding 'deepspeed/monitor/__init__.py'
2024-10-23T00:37:50,311   adding 'deepspeed/monitor/comet.py'
2024-10-23T00:37:50,312   adding 'deepspeed/monitor/config.py'
2024-10-23T00:37:50,313   adding 'deepspeed/monitor/csv_monitor.py'
2024-10-23T00:37:50,315   adding 'deepspeed/monitor/monitor.py'
2024-10-23T00:37:50,316   adding 'deepspeed/monitor/tensorboard.py'
2024-10-23T00:37:50,317   adding 'deepspeed/monitor/utils.py'
2024-10-23T00:37:50,319   adding 'deepspeed/monitor/wandb.py'
2024-10-23T00:37:50,320   adding 'deepspeed/nebula/__init__.py'
2024-10-23T00:37:50,321   adding 'deepspeed/nebula/config.py'
2024-10-23T00:37:50,323   adding 'deepspeed/nebula/constants.py'
2024-10-23T00:37:50,325   adding 'deepspeed/nvme/__init__.py'
2024-10-23T00:37:50,326   adding 'deepspeed/nvme/ds_aio_args.py'
2024-10-23T00:37:50,328   adding 'deepspeed/nvme/ds_aio_basic.py'
2024-10-23T00:37:50,329   adding 'deepspeed/nvme/ds_aio_handle.py'
2024-10-23T00:37:50,331   adding 'deepspeed/nvme/ds_aio_job.py'
2024-10-23T00:37:50,332   adding 'deepspeed/nvme/parse_nvme_stats.py'
2024-10-23T00:37:50,333   adding 'deepspeed/nvme/perf_generate_param.py'
2024-10-23T00:37:50,335   adding 'deepspeed/nvme/perf_run_sweep.py'
2024-10-23T00:37:50,337   adding 'deepspeed/nvme/perf_sweep_utils.py'
2024-10-23T00:37:50,338   adding 'deepspeed/nvme/test_ds_aio.py'
2024-10-23T00:37:50,339   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2024-10-23T00:37:50,340   adding 'deepspeed/nvme/validate_async_io.py'
2024-10-23T00:37:50,342   adding 'deepspeed/ops/__init__.py'
2024-10-23T00:37:50,344   adding 'deepspeed/ops/adagrad/__init__.py'
2024-10-23T00:37:50,345   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-10-23T00:37:50,347   adding 'deepspeed/ops/adam/__init__.py'
2024-10-23T00:37:50,348   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-10-23T00:37:50,350   adding 'deepspeed/ops/adam/fused_adam.py'
2024-10-23T00:37:50,351   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-10-23T00:37:50,353   adding 'deepspeed/ops/aio/__init__.py'
2024-10-23T00:37:50,356   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-10-23T00:37:50,358   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-10-23T00:37:50,359   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-10-23T00:37:50,360   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-10-23T00:37:50,362   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-10-23T00:37:50,364   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-10-23T00:37:50,367   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-10-23T00:37:50,368   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-10-23T00:37:50,369   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-10-23T00:37:50,371   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-10-23T00:37:50,372   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-10-23T00:37:50,373   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-10-23T00:37:50,375   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2024-10-23T00:37:50,376   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2024-10-23T00:37:50,378   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-10-23T00:37:50,379   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-10-23T00:37:50,380   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2024-10-23T00:37:50,381   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2024-10-23T00:37:50,383   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-10-23T00:37:50,384   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-10-23T00:37:50,385   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-10-23T00:37:50,387   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-10-23T00:37:50,388   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-10-23T00:37:50,389   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-10-23T00:37:50,391   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-10-23T00:37:50,392   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-10-23T00:37:50,393   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2024-10-23T00:37:50,395   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2024-10-23T00:37:50,396   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-10-23T00:37:50,398   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-10-23T00:37:50,400   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-10-23T00:37:50,403   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-10-23T00:37:50,406   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-10-23T00:37:50,407   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-10-23T00:37:50,409   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-10-23T00:37:50,410   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-10-23T00:37:50,412   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-10-23T00:37:50,414   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-10-23T00:37:50,416   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-10-23T00:37:50,418   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-10-23T00:37:50,426   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-10-23T00:37:50,431   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-10-23T00:37:50,433   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-10-23T00:37:50,436   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-10-23T00:37:50,438   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-10-23T00:37:50,440   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-10-23T00:37:50,442   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-10-23T00:37:50,444   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-10-23T00:37:50,447   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-10-23T00:37:50,449   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-10-23T00:37:50,451   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-10-23T00:37:50,453   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-10-23T00:37:50,461   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-10-23T00:37:50,465   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-10-23T00:37:50,466   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-10-23T00:37:50,470   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-10-23T00:37:50,474   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-10-23T00:37:50,478   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-10-23T00:37:50,480   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-10-23T00:37:50,481   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-10-23T00:37:50,483   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-10-23T00:37:50,485   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-10-23T00:37:50,487   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-10-23T00:37:50,489   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-10-23T00:37:50,491   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-10-23T00:37:50,493   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-10-23T00:37:50,495   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2024-10-23T00:37:50,496   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2024-10-23T00:37:50,498   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2024-10-23T00:37:50,499   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2024-10-23T00:37:50,501   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2024-10-23T00:37:50,502   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2024-10-23T00:37:50,504   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-10-23T00:37:50,506   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-10-23T00:37:50,507   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-10-23T00:37:50,508   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-10-23T00:37:50,510   adding 'deepspeed/ops/csrc/includes/context.h'
2024-10-23T00:37:50,512   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-10-23T00:37:50,513   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-10-23T00:37:50,515   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-10-23T00:37:50,516   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-10-23T00:37:50,518   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-10-23T00:37:50,520   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-10-23T00:37:50,521   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-10-23T00:37:50,523   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-10-23T00:37:50,524   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-10-23T00:37:50,525   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-10-23T00:37:50,527   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-10-23T00:37:50,528   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-10-23T00:37:50,530   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-10-23T00:37:50,531   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-10-23T00:37:50,533   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-10-23T00:37:50,535   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-10-23T00:37:50,537   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-10-23T00:37:50,539   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-10-23T00:37:50,540   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-10-23T00:37:50,543   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-10-23T00:37:50,545   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-10-23T00:37:50,546   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-10-23T00:37:50,547   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-10-23T00:37:50,549   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-10-23T00:37:50,551   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-10-23T00:37:50,553   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-10-23T00:37:50,555   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-10-23T00:37:50,556   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-10-23T00:37:50,558   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-10-23T00:37:50,559   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-10-23T00:37:50,561   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-10-23T00:37:50,563   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-10-23T00:37:50,565   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-10-23T00:37:50,567   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-10-23T00:37:50,569   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-10-23T00:37:50,571   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-10-23T00:37:50,572   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-10-23T00:37:50,574   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-10-23T00:37:50,576   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-10-23T00:37:50,578   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-10-23T00:37:50,579   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-10-23T00:37:50,581   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-10-23T00:37:50,583   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-10-23T00:37:50,585   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-10-23T00:37:50,587   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-10-23T00:37:50,588   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-10-23T00:37:50,591   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-10-23T00:37:50,594   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-10-23T00:37:50,598   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-10-23T00:37:50,600   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-10-23T00:37:50,602   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-10-23T00:37:50,606   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-10-23T00:37:50,609   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-10-23T00:37:50,611   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-10-23T00:37:50,614   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-10-23T00:37:50,616   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-10-23T00:37:50,619   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-10-23T00:37:50,621   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-10-23T00:37:50,623   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-10-23T00:37:50,628   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-10-23T00:37:50,630   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-10-23T00:37:50,632   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-10-23T00:37:50,635   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-10-23T00:37:50,638   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-10-23T00:37:50,640   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-10-23T00:37:50,642   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-10-23T00:37:50,644   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-10-23T00:37:50,646   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-10-23T00:37:50,648   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-10-23T00:37:50,650   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-10-23T00:37:50,651   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-10-23T00:37:50,653   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-10-23T00:37:50,655   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-10-23T00:37:50,657   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-10-23T00:37:50,658   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-10-23T00:37:50,660   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-10-23T00:37:50,661   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-10-23T00:37:50,663   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-10-23T00:37:50,665   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-10-23T00:37:50,666   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-10-23T00:37:50,668   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-10-23T00:37:50,670   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-10-23T00:37:50,671   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-10-23T00:37:50,673   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-10-23T00:37:50,674   adding 'deepspeed/ops/gds/__init__.py'
2024-10-23T00:37:50,676   adding 'deepspeed/ops/lamb/__init__.py'
2024-10-23T00:37:50,678   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-10-23T00:37:50,680   adding 'deepspeed/ops/lion/__init__.py'
2024-10-23T00:37:50,681   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-10-23T00:37:50,683   adding 'deepspeed/ops/lion/fused_lion.py'
2024-10-23T00:37:50,684   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-10-23T00:37:50,687   adding 'deepspeed/ops/op_builder/__init__.py'
2024-10-23T00:37:50,688   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-10-23T00:37:50,689   adding 'deepspeed/ops/op_builder/async_io.py'
2024-10-23T00:37:50,693   adding 'deepspeed/ops/op_builder/builder.py'
2024-10-23T00:37:50,695   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-10-23T00:37:50,696   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-10-23T00:37:50,697   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-10-23T00:37:50,699   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-10-23T00:37:50,700   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-10-23T00:37:50,701   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-10-23T00:37:50,702   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-10-23T00:37:50,703   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-10-23T00:37:50,705   adding 'deepspeed/ops/op_builder/gds.py'
2024-10-23T00:37:50,706   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-10-23T00:37:50,707   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-10-23T00:37:50,709   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-10-23T00:37:50,710   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-10-23T00:37:50,711   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-10-23T00:37:50,713   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-10-23T00:37:50,714   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-10-23T00:37:50,715   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-10-23T00:37:50,716   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-10-23T00:37:50,718   adding 'deepspeed/ops/op_builder/transformer.py'
2024-10-23T00:37:50,719   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-10-23T00:37:50,721   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-10-23T00:37:50,722   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2024-10-23T00:37:50,723   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-10-23T00:37:50,725   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-10-23T00:37:50,726   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-10-23T00:37:50,727   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-10-23T00:37:50,728   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-10-23T00:37:50,730   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-10-23T00:37:50,731   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-10-23T00:37:50,732   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-10-23T00:37:50,734   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-10-23T00:37:50,735   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-10-23T00:37:50,736   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2024-10-23T00:37:50,738   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2024-10-23T00:37:50,739   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2024-10-23T00:37:50,740   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2024-10-23T00:37:50,742   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2024-10-23T00:37:50,743   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2024-10-23T00:37:50,744   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2024-10-23T00:37:50,746   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-10-23T00:37:50,747   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-10-23T00:37:50,749   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-10-23T00:37:50,750   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-10-23T00:37:50,751   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-10-23T00:37:50,752   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-10-23T00:37:50,754   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-10-23T00:37:50,755   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-10-23T00:37:50,757   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-10-23T00:37:50,759   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-10-23T00:37:50,761   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-10-23T00:37:50,762   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-10-23T00:37:50,763   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-10-23T00:37:50,764   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-10-23T00:37:50,766   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-10-23T00:37:50,767   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-10-23T00:37:50,768   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-10-23T00:37:50,769   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-10-23T00:37:50,771   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-10-23T00:37:50,772   adding 'deepspeed/ops/quantizer/__init__.py'
2024-10-23T00:37:50,773   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-10-23T00:37:50,775   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-10-23T00:37:50,776   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-10-23T00:37:50,778   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-10-23T00:37:50,780   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-10-23T00:37:50,783   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-10-23T00:37:50,786   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-10-23T00:37:50,788   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-10-23T00:37:50,790   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-10-23T00:37:50,793   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-10-23T00:37:50,795   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-10-23T00:37:50,797   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-10-23T00:37:50,798   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-10-23T00:37:50,799   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-10-23T00:37:50,801   adding 'deepspeed/ops/transformer/__init__.py'
2024-10-23T00:37:50,806   adding 'deepspeed/ops/transformer/transformer.py'
2024-10-23T00:37:50,808   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-10-23T00:37:50,809   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-10-23T00:37:50,811   adding 'deepspeed/ops/transformer/inference/config.py'
2024-10-23T00:37:50,812   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-10-23T00:37:50,814   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-10-23T00:37:50,815   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-10-23T00:37:50,817   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-10-23T00:37:50,819   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-10-23T00:37:50,821   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-10-23T00:37:50,823   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-10-23T00:37:50,825   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-10-23T00:37:50,826   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-10-23T00:37:50,828   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2024-10-23T00:37:50,829   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2024-10-23T00:37:50,830   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2024-10-23T00:37:50,831   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2024-10-23T00:37:50,832   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2024-10-23T00:37:50,834   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2024-10-23T00:37:50,835   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-10-23T00:37:50,836   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2024-10-23T00:37:50,838   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-10-23T00:37:50,839   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-10-23T00:37:50,841   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2024-10-23T00:37:50,842   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2024-10-23T00:37:50,843   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2024-10-23T00:37:50,845   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-10-23T00:37:50,846   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-10-23T00:37:50,847   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2024-10-23T00:37:50,849   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-10-23T00:37:50,851   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-10-23T00:37:50,852   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2024-10-23T00:37:50,853   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-10-23T00:37:50,855   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2024-10-23T00:37:50,857   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-10-23T00:37:50,859   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-10-23T00:37:50,861   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-10-23T00:37:50,862   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-10-23T00:37:50,864   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-10-23T00:37:50,866   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-10-23T00:37:50,867   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-10-23T00:37:50,869   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-10-23T00:37:50,870   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-10-23T00:37:50,872   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-10-23T00:37:50,874   adding 'deepspeed/pipe/__init__.py'
2024-10-23T00:37:50,875   adding 'deepspeed/profiling/__init__.py'
2024-10-23T00:37:50,876   adding 'deepspeed/profiling/config.py'
2024-10-23T00:37:50,878   adding 'deepspeed/profiling/constants.py'
2024-10-23T00:37:50,879   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-10-23T00:37:50,885   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-10-23T00:37:50,887   adding 'deepspeed/runtime/__init__.py'
2024-10-23T00:37:50,888   adding 'deepspeed/runtime/base_optimizer.py'
2024-10-23T00:37:50,891   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-10-23T00:37:50,893   adding 'deepspeed/runtime/compiler.py'
2024-10-23T00:37:50,897   adding 'deepspeed/runtime/config.py'
2024-10-23T00:37:50,899   adding 'deepspeed/runtime/config_utils.py'
2024-10-23T00:37:50,901   adding 'deepspeed/runtime/constants.py'
2024-10-23T00:37:50,903   adding 'deepspeed/runtime/dataloader.py'
2024-10-23T00:37:50,905   adding 'deepspeed/runtime/eigenvalue.py'
2024-10-23T00:37:50,924   adding 'deepspeed/runtime/engine.py'
2024-10-23T00:37:50,927   adding 'deepspeed/runtime/hybrid_engine.py'
2024-10-23T00:37:50,931   adding 'deepspeed/runtime/lr_schedules.py'
2024-10-23T00:37:50,933   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-10-23T00:37:50,934   adding 'deepspeed/runtime/quantize.py'
2024-10-23T00:37:50,936   adding 'deepspeed/runtime/sparse_tensor.py'
2024-10-23T00:37:50,938   adding 'deepspeed/runtime/state_dict_factory.py'
2024-10-23T00:37:50,943   adding 'deepspeed/runtime/utils.py'
2024-10-23T00:37:50,945   adding 'deepspeed/runtime/weight_quantizer.py'
2024-10-23T00:37:50,946   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-10-23T00:37:50,951   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-10-23T00:37:50,953   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-10-23T00:37:50,955   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-10-23T00:37:50,956   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-10-23T00:37:50,958   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-10-23T00:37:50,959   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-10-23T00:37:50,960   adding 'deepspeed/runtime/comm/__init__.py'
2024-10-23T00:37:50,962   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-10-23T00:37:50,964   adding 'deepspeed/runtime/comm/compressed.py'
2024-10-23T00:37:50,965   adding 'deepspeed/runtime/comm/hccl.py'
2024-10-23T00:37:50,967   adding 'deepspeed/runtime/comm/mpi.py'
2024-10-23T00:37:50,969   adding 'deepspeed/runtime/comm/nccl.py'
2024-10-23T00:37:50,970   adding 'deepspeed/runtime/compression/__init__.py'
2024-10-23T00:37:50,972   adding 'deepspeed/runtime/compression/cupy.py'
2024-10-23T00:37:50,973   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-10-23T00:37:50,975   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-10-23T00:37:50,976   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-10-23T00:37:50,978   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-10-23T00:37:50,980   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-10-23T00:37:50,981   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-10-23T00:37:50,982   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-10-23T00:37:50,984   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-10-23T00:37:50,985   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-10-23T00:37:50,987   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-10-23T00:37:50,992   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-10-23T00:37:50,995   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-10-23T00:37:50,998   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-10-23T00:37:50,999   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-10-23T00:37:51,001   adding 'deepspeed/runtime/fp16/__init__.py'
2024-10-23T00:37:51,004   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-10-23T00:37:51,006   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-10-23T00:37:51,009   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-10-23T00:37:51,010   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-10-23T00:37:51,012   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-10-23T00:37:51,015   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-10-23T00:37:51,018   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-10-23T00:37:51,020   adding 'deepspeed/runtime/pipe/__init__.py'
2024-10-23T00:37:51,027   adding 'deepspeed/runtime/pipe/engine.py'
2024-10-23T00:37:51,031   adding 'deepspeed/runtime/pipe/module.py'
2024-10-23T00:37:51,032   adding 'deepspeed/runtime/pipe/p2p.py'
2024-10-23T00:37:51,035   adding 'deepspeed/runtime/pipe/schedule.py'
2024-10-23T00:37:51,037   adding 'deepspeed/runtime/pipe/topology.py'
2024-10-23T00:37:51,039   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-10-23T00:37:51,040   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-10-23T00:37:51,042   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-10-23T00:37:51,043   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-10-23T00:37:51,045   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-10-23T00:37:51,047   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-10-23T00:37:51,050   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-10-23T00:37:51,052   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-10-23T00:37:51,054   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-10-23T00:37:51,056   adding 'deepspeed/runtime/zero/__init__.py'
2024-10-23T00:37:51,058   adding 'deepspeed/runtime/zero/config.py'
2024-10-23T00:37:51,060   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-10-23T00:37:51,061   adding 'deepspeed/runtime/zero/linear.py'
2024-10-23T00:37:51,064   adding 'deepspeed/runtime/zero/mics.py'
2024-10-23T00:37:51,066   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-10-23T00:37:51,067   adding 'deepspeed/runtime/zero/offload_config.py'
2024-10-23T00:37:51,069   adding 'deepspeed/runtime/zero/offload_states.py'
2024-10-23T00:37:51,071   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-10-23T00:37:51,083   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-10-23T00:37:51,087   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-10-23T00:37:51,089   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-10-23T00:37:51,105   adding 'deepspeed/runtime/zero/stage3.py'
2024-10-23T00:37:51,119   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-10-23T00:37:51,121   adding 'deepspeed/runtime/zero/test.py'
2024-10-23T00:37:51,124   adding 'deepspeed/runtime/zero/tiling.py'
2024-10-23T00:37:51,125   adding 'deepspeed/runtime/zero/utils.py'
2024-10-23T00:37:51,127   adding 'deepspeed/sequence/__init__.py'
2024-10-23T00:37:51,128   adding 'deepspeed/sequence/cross_entropy.py'
2024-10-23T00:37:51,130   adding 'deepspeed/sequence/layer.py'
2024-10-23T00:37:51,132   adding 'deepspeed/utils/__init__.py'
2024-10-23T00:37:51,134   adding 'deepspeed/utils/bwc.py'
2024-10-23T00:37:51,135   adding 'deepspeed/utils/comms_logging.py'
2024-10-23T00:37:51,137   adding 'deepspeed/utils/config.py'
2024-10-23T00:37:51,138   adding 'deepspeed/utils/debug.py'
2024-10-23T00:37:51,139   adding 'deepspeed/utils/exceptions.py'
2024-10-23T00:37:51,142   adding 'deepspeed/utils/groups.py'
2024-10-23T00:37:51,144   adding 'deepspeed/utils/init_on_device.py'
2024-10-23T00:37:51,146   adding 'deepspeed/utils/logging.py'
2024-10-23T00:37:51,147   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-10-23T00:37:51,149   adding 'deepspeed/utils/numa.py'
2024-10-23T00:37:51,150   adding 'deepspeed/utils/nvtx.py'
2024-10-23T00:37:51,152   adding 'deepspeed/utils/tensor_fragment.py'
2024-10-23T00:37:51,154   adding 'deepspeed/utils/timer.py'
2024-10-23T00:37:51,155   adding 'deepspeed/utils/torch.py'
2024-10-23T00:37:51,156   adding 'deepspeed/utils/types.py'
2024-10-23T00:37:51,158   adding 'deepspeed/utils/z3_leaf_module.py'
2024-10-23T00:37:51,161   adding 'deepspeed/utils/zero_to_fp32.py'
2024-10-23T00:37:51,163   adding 'deepspeed-0.15.3.data/scripts/deepspeed'
2024-10-23T00:37:51,164   adding 'deepspeed-0.15.3.data/scripts/deepspeed.pt'
2024-10-23T00:37:51,166   adding 'deepspeed-0.15.3.data/scripts/ds'
2024-10-23T00:37:51,167   adding 'deepspeed-0.15.3.data/scripts/ds_bench'
2024-10-23T00:37:51,168   adding 'deepspeed-0.15.3.data/scripts/ds_elastic'
2024-10-23T00:37:51,169   adding 'deepspeed-0.15.3.data/scripts/ds_io'
2024-10-23T00:37:51,170   adding 'deepspeed-0.15.3.data/scripts/ds_nvme_tune'
2024-10-23T00:37:51,171   adding 'deepspeed-0.15.3.data/scripts/ds_report'
2024-10-23T00:37:51,172   adding 'deepspeed-0.15.3.data/scripts/ds_ssh'
2024-10-23T00:37:51,174   adding 'deepspeed-0.15.3.data/scripts/dsr'
2024-10-23T00:37:51,177   adding 'deepspeed-0.15.3.dist-info/LICENSE'
2024-10-23T00:37:51,182   adding 'deepspeed-0.15.3.dist-info/METADATA'
2024-10-23T00:37:51,183   adding 'deepspeed-0.15.3.dist-info/WHEEL'
2024-10-23T00:37:51,184   adding 'deepspeed-0.15.3.dist-info/entry_points.txt'
2024-10-23T00:37:51,185   adding 'deepspeed-0.15.3.dist-info/top_level.txt'
2024-10-23T00:37:51,200   adding 'deepspeed-0.15.3.dist-info/RECORD'
2024-10-23T00:37:51,237   removing build/bdist.linux-armv7l/wheel
2024-10-23T00:37:51,448   deepspeed build time = 10.465181827545166 secs
2024-10-23T00:37:51,551   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-10-23T00:37:51,569   Created wheel for deepspeed: filename=deepspeed-0.15.3-py3-none-any.whl size=1526167 sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8
2024-10-23T00:37:51,570   Stored in directory: /tmp/pip-ephem-wheel-cache-wzorzkz9/wheels/26/b5/64/1445950d3646458c6dd222273df19ae59b2b4daabe4e9ff23d
2024-10-23T00:37:51,612 Successfully built deepspeed
2024-10-23T00:37:51,662 Removed build tracker: '/tmp/pip-build-tracker-39viodqg'