2024-12-05T22:03:49,451 Created temporary directory: /tmp/pip-build-tracker-1rf53qi4
2024-12-05T22:03:49,452 Initialized build tracking at /tmp/pip-build-tracker-1rf53qi4
2024-12-05T22:03:49,453 Created build tracker: /tmp/pip-build-tracker-1rf53qi4
2024-12-05T22:03:49,453 Entered build tracker: /tmp/pip-build-tracker-1rf53qi4
2024-12-05T22:03:49,454 Created temporary directory: /tmp/pip-wheel-yw2eh6bi
2024-12-05T22:03:49,458 Created temporary directory: /tmp/pip-ephem-wheel-cache-li_afagh
2024-12-05T22:03:49,501 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-12-05T22:03:49,504 2 location(s) to search for versions of deepspeed:
2024-12-05T22:03:49,504 * https://pypi.org/simple/deepspeed/
2024-12-05T22:03:49,504 * https://www.piwheels.org/simple/deepspeed/
2024-12-05T22:03:49,505 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-12-05T22:03:49,506 Getting page https://pypi.org/simple/deepspeed/
2024-12-05T22:03:49,507 Found index url https://pypi.org/simple/
2024-12-05T22:03:49,657 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-12-05T22:03:49,677   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-05T22:03:49,678   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-12-05T22:03:49,679   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-05T22:03:49,679   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-12-05T22:03:49,680   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-05T22:03:49,680   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-12-05T22:03:49,681   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-05T22:03:49,682   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-12-05T22:03:49,682   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-05T22:03:49,683   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-12-05T22:03:49,684   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-12-05T22:03:49,684   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-12-05T22:03:49,685   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-12-05T22:03:49,686   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-12-05T22:03:49,687   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-12-05T22:03:49,687   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-12-05T22:03:49,688   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-12-05T22:03:49,688   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-12-05T22:03:49,689   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-12-05T22:03:49,689   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-12-05T22:03:49,690   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-12-05T22:03:49,691   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-12-05T22:03:49,691   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-12-05T22:03:49,692   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-12-05T22:03:49,693   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-12-05T22:03:49,694   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-12-05T22:03:49,695   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-12-05T22:03:49,695   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-12-05T22:03:49,696   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-12-05T22:03:49,697   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-12-05T22:03:49,698   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-12-05T22:03:49,699   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-12-05T22:03:49,699   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-12-05T22:03:49,700   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-12-05T22:03:49,700   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-12-05T22:03:49,701   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-12-05T22:03:49,702   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-12-05T22:03:49,702   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-12-05T22:03:49,703   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-12-05T22:03:49,703   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-12-05T22:03:49,704   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-12-05T22:03:49,705   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-12-05T22:03:49,706   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-12-05T22:03:49,706   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-12-05T22:03:49,707   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-12-05T22:03:49,708   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-12-05T22:03:49,708   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-12-05T22:03:49,709   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-12-05T22:03:49,710   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-12-05T22:03:49,710   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-12-05T22:03:49,711   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-12-05T22:03:49,712   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-12-05T22:03:49,712   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-12-05T22:03:49,713   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-12-05T22:03:49,714   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-12-05T22:03:49,714   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-12-05T22:03:49,715   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-12-05T22:03:49,715   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-12-05T22:03:49,716   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-12-05T22:03:49,717   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-12-05T22:03:49,718   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-12-05T22:03:49,718   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-12-05T22:03:49,719   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-12-05T22:03:49,720   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-12-05T22:03:49,720   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-12-05T22:03:49,721   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-12-05T22:03:49,722   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-12-05T22:03:49,722   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-12-05T22:03:49,724   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-12-05T22:03:49,724   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-12-05T22:03:49,725   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-12-05T22:03:49,725   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-12-05T22:03:49,726   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-12-05T22:03:49,726   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-12-05T22:03:49,727   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-12-05T22:03:49,728   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-12-05T22:03:49,728   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-12-05T22:03:49,729   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-12-05T22:03:49,730   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-12-05T22:03:49,731   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-12-05T22:03:49,731   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-12-05T22:03:49,732   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-12-05T22:03:49,733   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-12-05T22:03:49,733   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-12-05T22:03:49,734   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-12-05T22:03:49,735   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-12-05T22:03:49,736   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-12-05T22:03:49,736   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-12-05T22:03:49,737   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-12-05T22:03:49,738   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-12-05T22:03:49,738   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-12-05T22:03:49,739   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-12-05T22:03:49,739   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-12-05T22:03:49,740   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-12-05T22:03:49,740   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-12-05T22:03:49,741   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-12-05T22:03:49,742   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-12-05T22:03:49,742   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-12-05T22:03:49,743   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-12-05T22:03:49,744   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2024-12-05T22:03:49,744   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2024-12-05T22:03:49,745   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2024-12-05T22:03:49,746   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2024-12-05T22:03:49,746   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2024-12-05T22:03:49,747   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2024-12-05T22:03:49,748   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2024-12-05T22:03:49,749 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-12-05T22:03:49,749 Getting page https://www.piwheels.org/simple/deepspeed/
2024-12-05T22:03:49,750 Found index url https://www.piwheels.org/simple/
2024-12-05T22:03:49,938 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-12-05T22:03:49,957   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,958   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,958   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,959   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,960   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,960   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,961   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,961   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,962   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,963   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,963   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,964   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,965   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,965   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,966   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,966   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,967   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,967   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,968   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,968   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,969   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,969   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,970   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,971   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,971   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,972   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,973   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,974   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,974   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,975   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,975   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,976   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,976   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,977   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,977   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,978   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,979   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,979   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,980   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,981   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,981   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,982   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,983   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,983   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,984   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,984   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,985   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,985   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,986   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,986   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,987   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,988   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,988   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,989   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,989   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,990   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,991   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,991   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,992   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,992   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,992   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,993   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,993   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,994   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,994   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,995   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,995   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,996   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,997   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,997   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,998   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,999   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:49,999   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-05T22:03:50,000 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-12-05T22:03:50,000 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-12-05T22:03:50,032 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-12-05T22:03:50,034 Collecting deepspeed==0.16.1
2024-12-05T22:03:50,037   Created temporary directory: /tmp/pip-unpack-gaj4vv6v
2024-12-05T22:03:50,538   Downloading deepspeed-0.16.1.tar.gz (1.4 MB)
2024-12-05T22:03:53,112   Added deepspeed==0.16.1 from https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz to build tracker '/tmp/pip-build-tracker-1rf53qi4'
2024-12-05T22:03:53,115   Running setup.py (path:/tmp/pip-wheel-yw2eh6bi/deepspeed_3c523b222c204517900531fe12458965/setup.py) egg_info for package deepspeed
2024-12-05T22:03:53,116   Created temporary directory: /tmp/pip-pip-egg-info-zkpuqdsj
2024-12-05T22:03:53,117   Preparing metadata (setup.py): started
2024-12-05T22:03:53,118   Running command python setup.py egg_info
2024-12-05T22:03:54,046   fatal: not a git repository (or any of the parent directories): .git
2024-12-05T22:03:54,695   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-12-05T22:03:54,696    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-12-05T22:03:54,698   DS_BUILD_OPS=0
2024-12-05T22:03:54,698   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-12-05T22:03:54,699   version=0.16.1, git_hash=unknown, git_branch=unknown
2024-12-05T22:03:54,700   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-12-05T22:03:54,700   ext_modules=[]
2024-12-05T22:03:54,701   running egg_info
2024-12-05T22:03:54,725   creating /tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info
2024-12-05T22:03:54,726   writing /tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info/PKG-INFO
2024-12-05T22:03:54,760   writing dependency_links to /tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info/dependency_links.txt
2024-12-05T22:03:54,762   writing entry points to /tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info/entry_points.txt
2024-12-05T22:03:54,779   writing requirements to /tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info/requires.txt
2024-12-05T22:03:54,780   writing top-level names to /tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info/top_level.txt
2024-12-05T22:03:54,782   writing manifest file '/tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info/SOURCES.txt'
2024-12-05T22:03:55,020   reading manifest file '/tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info/SOURCES.txt'
2024-12-05T22:03:55,021   reading manifest template 'MANIFEST.in'
2024-12-05T22:03:55,023   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-12-05T22:03:55,024   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-12-05T22:03:56,650   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-12-05T22:03:57,595   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-12-05T22:03:58,267   warning: no files found matching '*.tr' under directory 'csrc'
2024-12-05T22:03:58,387   warning: no files found matching '*.cc' under directory 'csrc'
2024-12-05T22:03:58,433   warning: no files found matching '*.py' under directory 'benchmarks'
2024-12-05T22:03:58,439   adding license file 'LICENSE'
2024-12-05T22:03:58,485   writing manifest file '/tmp/pip-pip-egg-info-zkpuqdsj/deepspeed.egg-info/SOURCES.txt'
2024-12-05T22:03:58,488   deepspeed build time = 4.43779993057251 secs
2024-12-05T22:03:58,617   Preparing metadata (setup.py): finished with status 'done'
2024-12-05T22:03:58,623   Source in /tmp/pip-wheel-yw2eh6bi/deepspeed_3c523b222c204517900531fe12458965 has version 0.16.1, which satisfies requirement deepspeed==0.16.1 from https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz
2024-12-05T22:03:58,625   Removed deepspeed==0.16.1 from https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz from build tracker '/tmp/pip-build-tracker-1rf53qi4'
2024-12-05T22:03:58,697 Created temporary directory: /tmp/pip-unpack-kfdag8r8
2024-12-05T22:03:58,698 Created temporary directory: /tmp/pip-unpack-lak_vxdm
2024-12-05T22:03:58,698 Building wheels for collected packages: deepspeed
2024-12-05T22:03:58,703   Created temporary directory: /tmp/pip-wheel-e26rodfj
2024-12-05T22:03:58,703   Building wheel for deepspeed (setup.py): started
2024-12-05T22:03:58,705   Destination directory: /tmp/pip-wheel-e26rodfj
2024-12-05T22:03:58,705   Running command python setup.py bdist_wheel
2024-12-05T22:03:59,175   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-12-05T22:03:59,180    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-12-05T22:03:59,273   DS_BUILD_OPS=0
2024-12-05T22:03:59,390   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-12-05T22:03:59,409   fatal: not a git repository (or any of the parent directories): .git
2024-12-05T22:03:59,411   version=0.16.1, git_hash=unknown, git_branch=unknown
2024-12-05T22:03:59,412   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-12-05T22:03:59,412   ext_modules=[]
2024-12-05T22:04:00,010   running bdist_wheel
2024-12-05T22:04:00,143   running build
2024-12-05T22:04:00,144   running build_py
2024-12-05T22:04:00,174   creating build/lib/deepspeed
2024-12-05T22:04:00,176   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-12-05T22:04:00,178   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-12-05T22:04:00,180   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-12-05T22:04:00,183   copying deepspeed/constants.py -> build/lib/deepspeed
2024-12-05T22:04:00,185   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-12-05T22:04:00,188   creating build/lib/deepspeed/model_implementations
2024-12-05T22:04:00,190   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-12-05T22:04:00,192   creating build/lib/deepspeed/utils
2024-12-05T22:04:00,193   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,195   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,197   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,199   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,201   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,203   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,205   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,207   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,210   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,212   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,214   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,215   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,218   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,220   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,222   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,224   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,226   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,229   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-12-05T22:04:00,232   creating build/lib/deepspeed/module_inject
2024-12-05T22:04:00,233   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,236   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,238   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,240   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,241   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,243   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,246   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,248   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,250   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,252   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,255   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,257   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,260   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-12-05T22:04:00,263   creating build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,265   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,267   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,269   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,271   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,273   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,276   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,279   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,282   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,283   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,285   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-12-05T22:04:00,289   creating build/lib/deepspeed/nebula
2024-12-05T22:04:00,290   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-12-05T22:04:00,292   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-12-05T22:04:00,294   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-12-05T22:04:00,296   creating build/lib/deepspeed/accelerator
2024-12-05T22:04:00,297   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,300   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,302   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,305   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,306   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,309   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,311   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,314   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,316   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,318   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-05T22:04:00,321   creating build/lib/deepspeed/runtime
2024-12-05T22:04:00,322   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,324   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,328   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,330   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,333   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,336   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,338   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,341   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,343   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,348   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,351   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,353   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,355   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,358   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,360   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,362   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,365   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,367   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-12-05T22:04:00,370   creating build/lib/deepspeed/nvme
2024-12-05T22:04:00,371   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,374   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,376   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,378   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,380   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,382   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,384   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,387   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,388   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,390   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,392   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,394   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2024-12-05T22:04:00,397   creating build/lib/deepspeed/monitor
2024-12-05T22:04:00,398   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-12-05T22:04:00,400   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-12-05T22:04:00,402   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-12-05T22:04:00,404   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-12-05T22:04:00,406   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-12-05T22:04:00,408   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-12-05T22:04:00,410   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-12-05T22:04:00,411   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-12-05T22:04:00,414   creating build/lib/deepspeed/autotuning
2024-12-05T22:04:00,415   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-12-05T22:04:00,419   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-12-05T22:04:00,421   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-12-05T22:04:00,423   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-12-05T22:04:00,426   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-12-05T22:04:00,428   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-12-05T22:04:00,431   creating build/lib/deepspeed/launcher
2024-12-05T22:04:00,432   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-12-05T22:04:00,435   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-12-05T22:04:00,438   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-12-05T22:04:00,440   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-12-05T22:04:00,442   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-12-05T22:04:00,444   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-12-05T22:04:00,447   creating build/lib/deepspeed/pipe
2024-12-05T22:04:00,448   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-12-05T22:04:00,450   creating build/lib/deepspeed/sequence
2024-12-05T22:04:00,451   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-12-05T22:04:00,453   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-12-05T22:04:00,456   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2024-12-05T22:04:00,459   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2024-12-05T22:04:00,461   creating build/lib/deepspeed/linear
2024-12-05T22:04:00,462   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-12-05T22:04:00,465   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-12-05T22:04:00,466   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-12-05T22:04:00,469   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-12-05T22:04:00,470   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-12-05T22:04:00,473   creating build/lib/deepspeed/inference
2024-12-05T22:04:00,474   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-12-05T22:04:00,477   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-12-05T22:04:00,479   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-12-05T22:04:00,482   creating build/lib/deepspeed/profiling
2024-12-05T22:04:00,483   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-12-05T22:04:00,485   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-12-05T22:04:00,486   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-12-05T22:04:00,489   creating build/lib/deepspeed/elasticity
2024-12-05T22:04:00,490   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-12-05T22:04:00,491   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-12-05T22:04:00,493   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-12-05T22:04:00,495   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-12-05T22:04:00,497   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-12-05T22:04:00,499   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-12-05T22:04:00,502   creating build/lib/deepspeed/compression
2024-12-05T22:04:00,504   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-12-05T22:04:00,506   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-12-05T22:04:00,508   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-12-05T22:04:00,511   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-12-05T22:04:00,513   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-12-05T22:04:00,516   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-12-05T22:04:00,518   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-12-05T22:04:00,520   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-12-05T22:04:00,523   creating build/lib/deepspeed/moe
2024-12-05T22:04:00,524   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-12-05T22:04:00,527   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-12-05T22:04:00,529   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-12-05T22:04:00,531   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-12-05T22:04:00,533   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-12-05T22:04:00,535   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-12-05T22:04:00,538   creating build/lib/deepspeed/comm
2024-12-05T22:04:00,539   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,541   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,543   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,545   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,547   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,550   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,552   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,553   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,556   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-12-05T22:04:00,559   creating build/lib/deepspeed/ops
2024-12-05T22:04:00,560   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-12-05T22:04:00,562   creating build/lib/deepspeed/model_implementations/features
2024-12-05T22:04:00,564   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-12-05T22:04:00,566   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-12-05T22:04:00,568   creating build/lib/deepspeed/model_implementations/diffusers
2024-12-05T22:04:00,569   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-12-05T22:04:00,572   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-12-05T22:04:00,573   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-12-05T22:04:00,576   creating build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,577   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,579   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,580   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,582   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,584   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,586   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,588   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,590   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,591   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,593   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-05T22:04:00,596   creating build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,597   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,599   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,601   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,603   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,605   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,607   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,609   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,611   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,614   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,615   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,618   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,620   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,622   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,625   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,627   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,629   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,631   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,634   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,636   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-12-05T22:04:00,639   creating build/lib/deepspeed/module_inject/containers/features
2024-12-05T22:04:00,640   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-05T22:04:00,643   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-05T22:04:00,645   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-05T22:04:00,647   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-05T22:04:00,649   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-05T22:04:00,651   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-05T22:04:00,653   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-05T22:04:00,656   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:00,657   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:00,659   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:00,661   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:00,663   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:00,665   creating build/lib/deepspeed/runtime/data_pipeline
2024-12-05T22:04:00,666   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-12-05T22:04:00,669   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-12-05T22:04:00,671   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-12-05T22:04:00,674   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-12-05T22:04:00,676   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-12-05T22:04:00,678   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-12-05T22:04:00,680   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-12-05T22:04:00,683   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-12-05T22:04:00,687   creating build/lib/deepspeed/runtime/fp16
2024-12-05T22:04:00,689   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-12-05T22:04:00,692   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-12-05T22:04:00,695   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-12-05T22:04:00,698   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-12-05T22:04:00,703   creating build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,704   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,707   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,710   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,713   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,716   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,719   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,722   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,725   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,728   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-05T22:04:00,732   creating build/lib/deepspeed/runtime/pipe
2024-12-05T22:04:00,734   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-12-05T22:04:00,737   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-12-05T22:04:00,741   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-12-05T22:04:00,746   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-12-05T22:04:00,749   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-12-05T22:04:00,752   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-12-05T22:04:00,756   creating build/lib/deepspeed/runtime/domino
2024-12-05T22:04:00,757   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2024-12-05T22:04:00,761   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2024-12-05T22:04:00,764   creating build/lib/deepspeed/runtime/compression
2024-12-05T22:04:00,765   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-12-05T22:04:00,768   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-12-05T22:04:00,772   creating build/lib/deepspeed/runtime/comm
2024-12-05T22:04:00,773   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-12-05T22:04:00,776   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-12-05T22:04:00,780   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-12-05T22:04:00,783   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-12-05T22:04:00,786   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-12-05T22:04:00,788   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-12-05T22:04:00,792   creating build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,793   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,796   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,805   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,808   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,810   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,815   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,817   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,819   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,822   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,824   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,827   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,829   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,832   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,835   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,838   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,842   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,847   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2024-12-05T22:04:00,850   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:00,851   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:00,853   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:00,855   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:00,858   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:00,859   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:00,865   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:00,866   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:00,868   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:00,871   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:00,873   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:00,876   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:00,879   creating build/lib/deepspeed/runtime/fp16/onebit
2024-12-05T22:04:00,880   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-12-05T22:04:00,882   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-12-05T22:04:00,885   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-12-05T22:04:00,888   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-12-05T22:04:00,891   creating build/lib/deepspeed/autotuning/tuner
2024-12-05T22:04:00,892   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-12-05T22:04:00,895   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-12-05T22:04:00,897   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-12-05T22:04:00,899   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-12-05T22:04:00,901   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-12-05T22:04:00,902   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-12-05T22:04:00,905   creating build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,906   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,909   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,911   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,912   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,914   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,916   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,918   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,921   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,923   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-12-05T22:04:00,925   creating build/lib/deepspeed/inference/quantization
2024-12-05T22:04:00,926   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-12-05T22:04:00,929   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-12-05T22:04:00,931   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-12-05T22:04:00,932   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-12-05T22:04:00,935   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-12-05T22:04:00,938   creating build/lib/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:00,939   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:00,942   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:00,944   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:00,947   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:00,950   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:00,952   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:00,954   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:00,958   creating build/lib/deepspeed/inference/v2/checkpoint
2024-12-05T22:04:00,959   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-12-05T22:04:00,963   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-12-05T22:04:00,965   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-12-05T22:04:00,967   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-12-05T22:04:00,970   creating build/lib/deepspeed/inference/v2/modules
2024-12-05T22:04:00,971   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-12-05T22:04:00,974   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-12-05T22:04:00,976   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-12-05T22:04:00,978   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-12-05T22:04:00,980   creating build/lib/deepspeed/inference/v2/ragged
2024-12-05T22:04:00,982   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-05T22:04:00,984   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-05T22:04:00,986   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-05T22:04:00,988   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-05T22:04:00,992   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-05T22:04:00,996   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-05T22:04:01,000   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-05T22:04:01,004   creating build/lib/deepspeed/inference/v2/kernels
2024-12-05T22:04:01,005   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-12-05T22:04:01,007   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-12-05T22:04:01,010   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:01,011   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:01,013   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:01,015   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:01,017   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:01,020   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:01,021   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:01,023   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:01,025   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:01,027   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:01,030   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:01,031   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:01,033   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:01,035   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:01,037   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:01,039   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:01,041   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:01,043   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:01,045   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:01,048   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:01,050   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:01,051   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:01,054   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:01,055   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:01,058   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:01,060   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:01,061   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:01,063   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:01,066   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:01,068   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:01,070   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:01,071   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:01,073   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:01,076   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:01,078   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:01,081   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,082   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,084   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,086   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,089   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,091   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,093   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,095   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,097   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,099   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:01,102   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:01,103   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:01,106   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:01,108   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:01,110   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:01,113   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:01,114   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:01,116   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:01,119   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:01,121   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:01,124   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:01,126   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:01,128   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:01,130   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:01,132   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:01,135   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,136   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,138   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,140   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,143   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,145   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,147   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,149   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,151   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,153   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:01,156   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,157   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,159   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,161   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,163   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,165   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,167   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,169   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,171   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:01,174   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-12-05T22:04:01,175   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-12-05T22:04:01,178   creating build/lib/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:01,179   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:01,181   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:01,184   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:01,186   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:01,188   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:01,190   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:01,192   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:01,194   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-12-05T22:04:01,195   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-12-05T22:04:01,198   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-12-05T22:04:01,201   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-12-05T22:04:01,202   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-12-05T22:04:01,204   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-12-05T22:04:01,206   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-12-05T22:04:01,210   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-05T22:04:01,211   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-05T22:04:01,213   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-05T22:04:01,215   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-05T22:04:01,218   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-12-05T22:04:01,219   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-12-05T22:04:01,222   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-12-05T22:04:01,224   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-12-05T22:04:01,226   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-12-05T22:04:01,228   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-12-05T22:04:01,230   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-12-05T22:04:01,231   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-12-05T22:04:01,233   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-12-05T22:04:01,236   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-12-05T22:04:01,238   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-12-05T22:04:01,240   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-12-05T22:04:01,243   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-12-05T22:04:01,244   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-12-05T22:04:01,246   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-12-05T22:04:01,248   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-12-05T22:04:01,250   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-12-05T22:04:01,251   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-12-05T22:04:01,255   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:01,256   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:01,258   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:01,260   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:01,263   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:01,264   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:01,267   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:01,270   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:01,271   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:01,273   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:01,276   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:01,278   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:01,281   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:01,285   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:01,287   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:01,290   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:01,293   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:01,294   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:01,297   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:01,300   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:01,302   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:01,304   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:01,306   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:01,308   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:01,310   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:01,311   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:01,313   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:01,316   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:01,317   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:01,320   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:01,323   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:01,324   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:01,326   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:01,328   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:01,330   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:01,332   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:01,334   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:01,336   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:01,338   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:01,340   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:01,342   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:01,343   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:01,346   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:01,348   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:01,350   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:01,351   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:01,353   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:01,356   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:01,357   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:01,359   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:01,362   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:01,363   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:01,366   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:01,367   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:01,370   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:01,372   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:01,374   creating build/lib/deepspeed/profiling/flops_profiler
2024-12-05T22:04:01,375   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-12-05T22:04:01,379   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-12-05T22:04:01,381   creating build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,383   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,385   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,387   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,389   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,391   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,393   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,396   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,398   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,400   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,402   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,404   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,406   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,408   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,410   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,412   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,414   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,417   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,419   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,421   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,423   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,424   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,426   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,428   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,430   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2024-12-05T22:04:01,433   creating build/lib/deepspeed/ops/lion
2024-12-05T22:04:01,434   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-12-05T22:04:01,436   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-12-05T22:04:01,438   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-12-05T22:04:01,440   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-12-05T22:04:01,443   creating build/lib/deepspeed/ops/lamb
2024-12-05T22:04:01,443   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-12-05T22:04:01,446   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-12-05T22:04:01,449   creating build/lib/deepspeed/ops/gds
2024-12-05T22:04:01,450   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2024-12-05T22:04:01,452   creating build/lib/deepspeed/ops/quantizer
2024-12-05T22:04:01,454   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-12-05T22:04:01,455   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-12-05T22:04:01,458   creating build/lib/deepspeed/ops/deepspeed4science
2024-12-05T22:04:01,459   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-12-05T22:04:01,461   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-12-05T22:04:01,464   creating build/lib/deepspeed/ops/aio
2024-12-05T22:04:01,465   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-12-05T22:04:01,468   creating build/lib/deepspeed/ops/random_ltd
2024-12-05T22:04:01,469   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-12-05T22:04:01,471   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-12-05T22:04:01,474   creating build/lib/deepspeed/ops/adagrad
2024-12-05T22:04:01,475   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-12-05T22:04:01,477   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-12-05T22:04:01,480   creating build/lib/deepspeed/ops/transformer
2024-12-05T22:04:01,481   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-12-05T22:04:01,484   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-12-05T22:04:01,487   creating build/lib/deepspeed/ops/adam
2024-12-05T22:04:01,488   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-12-05T22:04:01,491   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-12-05T22:04:01,493   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-12-05T22:04:01,495   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-12-05T22:04:01,498   creating build/lib/deepspeed/ops/sparse_attention
2024-12-05T22:04:01,499   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-05T22:04:01,502   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-05T22:04:01,505   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-05T22:04:01,507   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-05T22:04:01,509   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-05T22:04:01,512   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-05T22:04:01,515   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-05T22:04:01,518   creating build/lib/deepspeed/ops/fp_quantizer
2024-12-05T22:04:01,519   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-12-05T22:04:01,521   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-12-05T22:04:01,524   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-12-05T22:04:01,527   creating build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,529   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,531   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,534   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,536   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,538   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,540   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,542   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,544   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,546   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,548   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:01,551   creating build/lib/deepspeed/ops/op_builder/hpu
2024-12-05T22:04:01,552   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-05T22:04:01,554   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-05T22:04:01,556   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-05T22:04:01,558   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-05T22:04:01,560   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-05T22:04:01,562   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-05T22:04:01,565   creating build/lib/deepspeed/ops/op_builder/mlu
2024-12-05T22:04:01,566   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-05T22:04:01,568   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-05T22:04:01,570   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-05T22:04:01,573   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-05T22:04:01,575   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-05T22:04:01,577   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-05T22:04:01,579   creating build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,580   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,582   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,584   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,586   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,588   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,590   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,592   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,594   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,596   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-05T22:04:01,599   creating build/lib/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:01,600   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:01,602   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:01,604   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:01,606   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:01,608   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:01,611   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:01,613   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:01,616   creating build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,617   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,620   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,622   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,624   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,627   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,629   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,632   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,634   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,637   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,639   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-05T22:04:01,642   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,643   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,646   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,648   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,651   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,653   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,655   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,658   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,660   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,662   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,665   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:01,668   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,669   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,671   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,673   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,676   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,678   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,680   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,682   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,685   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,687   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,689   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,691   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,693   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,695   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,697   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,700   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,702   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,704   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,706   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,708   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,710   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,712   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,714   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,716   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:01,718   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:01,720   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:01,723   running egg_info
2024-12-05T22:04:01,751   writing deepspeed.egg-info/PKG-INFO
2024-12-05T22:04:01,783   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-12-05T22:04:01,785   writing entry points to deepspeed.egg-info/entry_points.txt
2024-12-05T22:04:01,802   writing requirements to deepspeed.egg-info/requires.txt
2024-12-05T22:04:01,803   writing top-level names to deepspeed.egg-info/top_level.txt
2024-12-05T22:04:01,936   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-12-05T22:04:02,018   reading manifest template 'MANIFEST.in'
2024-12-05T22:04:02,020   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-12-05T22:04:02,020   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-12-05T22:04:03,639   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-12-05T22:04:04,668   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-12-05T22:04:05,306   warning: no files found matching '*.tr' under directory 'csrc'
2024-12-05T22:04:05,500   warning: no files found matching '*.cc' under directory 'csrc'
2024-12-05T22:04:05,549   warning: no files found matching '*.py' under directory 'benchmarks'
2024-12-05T22:04:05,555   adding license file 'LICENSE'
2024-12-05T22:04:05,605   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-12-05T22:04:05,613   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-12-05T22:04:05,614   !!

2024-12-05T22:04:05,615           ********************************************************************************
2024-12-05T22:04:05,616           ############################
2024-12-05T22:04:05,616           # Package would be ignored #
2024-12-05T22:04:05,617           ############################
2024-12-05T22:04:05,617           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-12-05T22:04:05,618           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,619           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,620           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-12-05T22:04:05,620           to the `packages` configuration field.

2024-12-05T22:04:05,621           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,622           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,623           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,624           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,625           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,626           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-12-05T22:04:05,626           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-12-05T22:04:05,626           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,627           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,627           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,628           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,629           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,630           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,630                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,631                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,631                 directory, all directories are treated like packages.
2024-12-05T22:04:05,632           ********************************************************************************

2024-12-05T22:04:05,632   !!
2024-12-05T22:04:05,633     check.warn(importable)
2024-12-05T22:04:05,633   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-12-05T22:04:05,634   !!

2024-12-05T22:04:05,635           ********************************************************************************
2024-12-05T22:04:05,636           ############################
2024-12-05T22:04:05,636           # Package would be ignored #
2024-12-05T22:04:05,637           ############################
2024-12-05T22:04:05,637           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-12-05T22:04:05,638           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,639           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,640           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-12-05T22:04:05,640           to the `packages` configuration field.

2024-12-05T22:04:05,641           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,642           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,642           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,643           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,645           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,646           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-12-05T22:04:05,646           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-12-05T22:04:05,647           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,647           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,648           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,649           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,650           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,651           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,651                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,652                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,652                 directory, all directories are treated like packages.
2024-12-05T22:04:05,652           ********************************************************************************

2024-12-05T22:04:05,653   !!
2024-12-05T22:04:05,653     check.warn(importable)
2024-12-05T22:04:05,654   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-12-05T22:04:05,654   !!

2024-12-05T22:04:05,655           ********************************************************************************
2024-12-05T22:04:05,655           ############################
2024-12-05T22:04:05,655           # Package would be ignored #
2024-12-05T22:04:05,656           ############################
2024-12-05T22:04:05,656           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-12-05T22:04:05,657           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,657           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,658           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-12-05T22:04:05,658           to the `packages` configuration field.

2024-12-05T22:04:05,659           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,660           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,660           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,661           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,662           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,663           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-12-05T22:04:05,663           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-12-05T22:04:05,664           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,665           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,665           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,666           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,667           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,669           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,669                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,670                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,670                 directory, all directories are treated like packages.
2024-12-05T22:04:05,670           ********************************************************************************

2024-12-05T22:04:05,672   !!
2024-12-05T22:04:05,672     check.warn(importable)
2024-12-05T22:04:05,673   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-12-05T22:04:05,673   !!

2024-12-05T22:04:05,674           ********************************************************************************
2024-12-05T22:04:05,675           ############################
2024-12-05T22:04:05,676           # Package would be ignored #
2024-12-05T22:04:05,676           ############################
2024-12-05T22:04:05,676           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-12-05T22:04:05,677           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,678           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,678           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-12-05T22:04:05,678           to the `packages` configuration field.

2024-12-05T22:04:05,679           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,679           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,680           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,681           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,681           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,682           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-12-05T22:04:05,682           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-12-05T22:04:05,683           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,683           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,684           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,685           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,686           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,687           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,688                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,689                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,689                 directory, all directories are treated like packages.
2024-12-05T22:04:05,690           ********************************************************************************

2024-12-05T22:04:05,691   !!
2024-12-05T22:04:05,692     check.warn(importable)
2024-12-05T22:04:05,692   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-12-05T22:04:05,693   !!

2024-12-05T22:04:05,694           ********************************************************************************
2024-12-05T22:04:05,694           ############################
2024-12-05T22:04:05,695           # Package would be ignored #
2024-12-05T22:04:05,695           ############################
2024-12-05T22:04:05,695           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-12-05T22:04:05,696           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,697           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,698           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-12-05T22:04:05,698           to the `packages` configuration field.

2024-12-05T22:04:05,699           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,700           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,700           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,701           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,702           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,703           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-12-05T22:04:05,704           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-12-05T22:04:05,704           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,704           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,705           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,706           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,707           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,708           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,708                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,709                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,709                 directory, all directories are treated like packages.
2024-12-05T22:04:05,709           ********************************************************************************

2024-12-05T22:04:05,710   !!
2024-12-05T22:04:05,710     check.warn(importable)
2024-12-05T22:04:05,711   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-12-05T22:04:05,711   !!

2024-12-05T22:04:05,712           ********************************************************************************
2024-12-05T22:04:05,713           ############################
2024-12-05T22:04:05,713           # Package would be ignored #
2024-12-05T22:04:05,713           ############################
2024-12-05T22:04:05,714           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-12-05T22:04:05,715           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,716           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,716           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-12-05T22:04:05,717           to the `packages` configuration field.

2024-12-05T22:04:05,718           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,718           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,719           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,720           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,721           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,722           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-12-05T22:04:05,723           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-12-05T22:04:05,723           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,723           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,724           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,725           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,726           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,728           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,728                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,729                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,730                 directory, all directories are treated like packages.
2024-12-05T22:04:05,730           ********************************************************************************

2024-12-05T22:04:05,731   !!
2024-12-05T22:04:05,731     check.warn(importable)
2024-12-05T22:04:05,731   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-12-05T22:04:05,732   !!

2024-12-05T22:04:05,733           ********************************************************************************
2024-12-05T22:04:05,733           ############################
2024-12-05T22:04:05,733           # Package would be ignored #
2024-12-05T22:04:05,734           ############################
2024-12-05T22:04:05,734           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-12-05T22:04:05,734           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,735           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,735           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-12-05T22:04:05,736           to the `packages` configuration field.

2024-12-05T22:04:05,737           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,737           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,737           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,738           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,739           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,740           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-12-05T22:04:05,741           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-12-05T22:04:05,741           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,742           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,742           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,743           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,745           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,746           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,747                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,747                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,748                 directory, all directories are treated like packages.
2024-12-05T22:04:05,748           ********************************************************************************

2024-12-05T22:04:05,749   !!
2024-12-05T22:04:05,750     check.warn(importable)
2024-12-05T22:04:05,750   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-12-05T22:04:05,751   !!

2024-12-05T22:04:05,752           ********************************************************************************
2024-12-05T22:04:05,752           ############################
2024-12-05T22:04:05,753           # Package would be ignored #
2024-12-05T22:04:05,753           ############################
2024-12-05T22:04:05,753           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-12-05T22:04:05,754           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,755           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,756           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-12-05T22:04:05,757           to the `packages` configuration field.

2024-12-05T22:04:05,757           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,758           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,758           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,759           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,759           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,760           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-12-05T22:04:05,761           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-12-05T22:04:05,761           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,761           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,762           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,763           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,763           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,765           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,765                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,765                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,766                 directory, all directories are treated like packages.
2024-12-05T22:04:05,766           ********************************************************************************

2024-12-05T22:04:05,767   !!
2024-12-05T22:04:05,768     check.warn(importable)
2024-12-05T22:04:05,768   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-12-05T22:04:05,769   !!

2024-12-05T22:04:05,770           ********************************************************************************
2024-12-05T22:04:05,770           ############################
2024-12-05T22:04:05,771           # Package would be ignored #
2024-12-05T22:04:05,771           ############################
2024-12-05T22:04:05,772           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-12-05T22:04:05,773           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,774           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,774           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-12-05T22:04:05,774           to the `packages` configuration field.

2024-12-05T22:04:05,775           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,776           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,776           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,777           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,779           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,780           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-12-05T22:04:05,780           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-12-05T22:04:05,781           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,782           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,782           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,783           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,784           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,785           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,785                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,786                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,786                 directory, all directories are treated like packages.
2024-12-05T22:04:05,786           ********************************************************************************

2024-12-05T22:04:05,787   !!
2024-12-05T22:04:05,787     check.warn(importable)
2024-12-05T22:04:05,788   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-12-05T22:04:05,788   !!

2024-12-05T22:04:05,789           ********************************************************************************
2024-12-05T22:04:05,789           ############################
2024-12-05T22:04:05,790           # Package would be ignored #
2024-12-05T22:04:05,790           ############################
2024-12-05T22:04:05,790           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-12-05T22:04:05,791           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,791           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,792           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-12-05T22:04:05,792           to the `packages` configuration field.

2024-12-05T22:04:05,793           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,794           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,794           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,795           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,796           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,797           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-12-05T22:04:05,798           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-12-05T22:04:05,798           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,799           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,799           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,800           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,801           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,802           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,803                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,803                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,804                 directory, all directories are treated like packages.
2024-12-05T22:04:05,804           ********************************************************************************

2024-12-05T22:04:05,805   !!
2024-12-05T22:04:05,806     check.warn(importable)
2024-12-05T22:04:05,806   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-12-05T22:04:05,807   !!

2024-12-05T22:04:05,808           ********************************************************************************
2024-12-05T22:04:05,808           ############################
2024-12-05T22:04:05,809           # Package would be ignored #
2024-12-05T22:04:05,809           ############################
2024-12-05T22:04:05,809           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-12-05T22:04:05,810           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,810           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,811           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-12-05T22:04:05,811           to the `packages` configuration field.

2024-12-05T22:04:05,812           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,812           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,813           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,813           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,814           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,815           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-12-05T22:04:05,815           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-12-05T22:04:05,816           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,816           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,816           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,817           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,818           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,819           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,819                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,820                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,821                 directory, all directories are treated like packages.
2024-12-05T22:04:05,821           ********************************************************************************

2024-12-05T22:04:05,822   !!
2024-12-05T22:04:05,823     check.warn(importable)
2024-12-05T22:04:05,823   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-12-05T22:04:05,824   !!

2024-12-05T22:04:05,825           ********************************************************************************
2024-12-05T22:04:05,825           ############################
2024-12-05T22:04:05,826           # Package would be ignored #
2024-12-05T22:04:05,826           ############################
2024-12-05T22:04:05,827           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-12-05T22:04:05,827           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,828           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,829           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-12-05T22:04:05,829           to the `packages` configuration field.

2024-12-05T22:04:05,830           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,831           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,831           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,832           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,833           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,834           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-12-05T22:04:05,835           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-12-05T22:04:05,836           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,836           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,837           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,837           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,838           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,839           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,839                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,840                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,840                 directory, all directories are treated like packages.
2024-12-05T22:04:05,841           ********************************************************************************

2024-12-05T22:04:05,841   !!
2024-12-05T22:04:05,842     check.warn(importable)
2024-12-05T22:04:05,842   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-12-05T22:04:05,843   !!

2024-12-05T22:04:05,844           ********************************************************************************
2024-12-05T22:04:05,844           ############################
2024-12-05T22:04:05,845           # Package would be ignored #
2024-12-05T22:04:05,845           ############################
2024-12-05T22:04:05,845           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-12-05T22:04:05,846           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,846           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,847           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-12-05T22:04:05,847           to the `packages` configuration field.

2024-12-05T22:04:05,849           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,849           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,850           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,851           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,852           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,853           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-12-05T22:04:05,854           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-12-05T22:04:05,854           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,854           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,855           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,856           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,857           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,858           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,859                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,859                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,860                 directory, all directories are treated like packages.
2024-12-05T22:04:05,860           ********************************************************************************

2024-12-05T22:04:05,861   !!
2024-12-05T22:04:05,862     check.warn(importable)
2024-12-05T22:04:05,862   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-12-05T22:04:05,862   !!

2024-12-05T22:04:05,863           ********************************************************************************
2024-12-05T22:04:05,863           ############################
2024-12-05T22:04:05,864           # Package would be ignored #
2024-12-05T22:04:05,864           ############################
2024-12-05T22:04:05,864           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-12-05T22:04:05,865           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,865           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,866           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-12-05T22:04:05,866           to the `packages` configuration field.

2024-12-05T22:04:05,867           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,867           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,867           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,868           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,869           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,870           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-12-05T22:04:05,870           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-12-05T22:04:05,870           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,871           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,871           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,872           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,873           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,875           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,876                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,876                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,877                 directory, all directories are treated like packages.
2024-12-05T22:04:05,877           ********************************************************************************

2024-12-05T22:04:05,878   !!
2024-12-05T22:04:05,879     check.warn(importable)
2024-12-05T22:04:05,879   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-12-05T22:04:05,879   !!

2024-12-05T22:04:05,881           ********************************************************************************
2024-12-05T22:04:05,881           ############################
2024-12-05T22:04:05,882           # Package would be ignored #
2024-12-05T22:04:05,882           ############################
2024-12-05T22:04:05,882           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-12-05T22:04:05,883           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,884           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,885           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-12-05T22:04:05,885           to the `packages` configuration field.

2024-12-05T22:04:05,886           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,887           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,887           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,888           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,889           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,890           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-12-05T22:04:05,890           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-12-05T22:04:05,890           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,891           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,891           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,892           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,893           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,894           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,894                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,895                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,895                 directory, all directories are treated like packages.
2024-12-05T22:04:05,895           ********************************************************************************

2024-12-05T22:04:05,896   !!
2024-12-05T22:04:05,897     check.warn(importable)
2024-12-05T22:04:05,897   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-12-05T22:04:05,897   !!

2024-12-05T22:04:05,898           ********************************************************************************
2024-12-05T22:04:05,899           ############################
2024-12-05T22:04:05,900           # Package would be ignored #
2024-12-05T22:04:05,900           ############################
2024-12-05T22:04:05,901           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-12-05T22:04:05,901           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,902           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,903           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-12-05T22:04:05,903           to the `packages` configuration field.

2024-12-05T22:04:05,905           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,905           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,906           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,906           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,907           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,908           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-12-05T22:04:05,909           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-12-05T22:04:05,909           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,910           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,910           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,911           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,913           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,914           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,915                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,916                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,916                 directory, all directories are treated like packages.
2024-12-05T22:04:05,916           ********************************************************************************

2024-12-05T22:04:05,917   !!
2024-12-05T22:04:05,917     check.warn(importable)
2024-12-05T22:04:05,918   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-12-05T22:04:05,918   !!

2024-12-05T22:04:05,919           ********************************************************************************
2024-12-05T22:04:05,919           ############################
2024-12-05T22:04:05,919           # Package would be ignored #
2024-12-05T22:04:05,920           ############################
2024-12-05T22:04:05,920           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-12-05T22:04:05,921           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,922           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,922           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-12-05T22:04:05,923           to the `packages` configuration field.

2024-12-05T22:04:05,924           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,925           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,926           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,927           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,929           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,930           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-12-05T22:04:05,931           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-12-05T22:04:05,932           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,932           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,933           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,935           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,936           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,938           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,939                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,939                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,940                 directory, all directories are treated like packages.
2024-12-05T22:04:05,941           ********************************************************************************

2024-12-05T22:04:05,942   !!
2024-12-05T22:04:05,943     check.warn(importable)
2024-12-05T22:04:05,943   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-12-05T22:04:05,944   !!

2024-12-05T22:04:05,946           ********************************************************************************
2024-12-05T22:04:05,946           ############################
2024-12-05T22:04:05,947           # Package would be ignored #
2024-12-05T22:04:05,948           ############################
2024-12-05T22:04:05,948           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-12-05T22:04:05,949           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,951           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,951           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-12-05T22:04:05,952           to the `packages` configuration field.

2024-12-05T22:04:05,953           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,953           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,954           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,955           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,956           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,957           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-12-05T22:04:05,957           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-12-05T22:04:05,958           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,958           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,959           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,960           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,961           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,963           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,963                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,964                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,965                 directory, all directories are treated like packages.
2024-12-05T22:04:05,966           ********************************************************************************

2024-12-05T22:04:05,967   !!
2024-12-05T22:04:05,968     check.warn(importable)
2024-12-05T22:04:05,968   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-12-05T22:04:05,969   !!

2024-12-05T22:04:05,970           ********************************************************************************
2024-12-05T22:04:05,971           ############################
2024-12-05T22:04:05,972           # Package would be ignored #
2024-12-05T22:04:05,973           ############################
2024-12-05T22:04:05,973           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-12-05T22:04:05,974           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,975           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:05,976           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-12-05T22:04:05,977           to the `packages` configuration field.

2024-12-05T22:04:05,978           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:05,979           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:05,979           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:05,981           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:05,982           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:05,984           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-12-05T22:04:05,984           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-12-05T22:04:05,985           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:05,985           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:05,986           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:05,987           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:05,988           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:05,989           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:05,990                 even if it does not contain any `.py` files.
2024-12-05T22:04:05,990                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:05,991                 directory, all directories are treated like packages.
2024-12-05T22:04:05,991           ********************************************************************************

2024-12-05T22:04:05,992   !!
2024-12-05T22:04:05,993     check.warn(importable)
2024-12-05T22:04:05,993   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-12-05T22:04:05,994   !!

2024-12-05T22:04:05,995           ********************************************************************************
2024-12-05T22:04:05,995           ############################
2024-12-05T22:04:05,996           # Package would be ignored #
2024-12-05T22:04:05,997           ############################
2024-12-05T22:04:05,997           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-12-05T22:04:05,998           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:05,999           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,000           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-12-05T22:04:06,001           to the `packages` configuration field.

2024-12-05T22:04:06,002           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,003           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,004           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,005           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,006           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,007           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-12-05T22:04:06,008           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-12-05T22:04:06,009           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,009           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,010           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,011           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,013           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,015           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,016                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,017                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,018                 directory, all directories are treated like packages.
2024-12-05T22:04:06,019           ********************************************************************************

2024-12-05T22:04:06,020   !!
2024-12-05T22:04:06,021     check.warn(importable)
2024-12-05T22:04:06,021   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-12-05T22:04:06,022   !!

2024-12-05T22:04:06,023           ********************************************************************************
2024-12-05T22:04:06,023           ############################
2024-12-05T22:04:06,024           # Package would be ignored #
2024-12-05T22:04:06,024           ############################
2024-12-05T22:04:06,025           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-12-05T22:04:06,025           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,026           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,027           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-12-05T22:04:06,027           to the `packages` configuration field.

2024-12-05T22:04:06,028           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,029           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,029           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,030           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,031           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,033           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-12-05T22:04:06,033           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-12-05T22:04:06,034           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,035           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,035           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,037           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,038           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,040           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,041                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,041                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,042                 directory, all directories are treated like packages.
2024-12-05T22:04:06,042           ********************************************************************************

2024-12-05T22:04:06,044   !!
2024-12-05T22:04:06,044     check.warn(importable)
2024-12-05T22:04:06,045   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-12-05T22:04:06,046   !!

2024-12-05T22:04:06,047           ********************************************************************************
2024-12-05T22:04:06,048           ############################
2024-12-05T22:04:06,048           # Package would be ignored #
2024-12-05T22:04:06,049           ############################
2024-12-05T22:04:06,050           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-12-05T22:04:06,050           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,052           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,053           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-12-05T22:04:06,053           to the `packages` configuration field.

2024-12-05T22:04:06,055           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,055           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,056           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,057           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,059           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,060           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-12-05T22:04:06,061           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-12-05T22:04:06,062           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,062           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,063           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,064           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,065           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,067           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,067                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,068                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,068                 directory, all directories are treated like packages.
2024-12-05T22:04:06,069           ********************************************************************************

2024-12-05T22:04:06,070   !!
2024-12-05T22:04:06,071     check.warn(importable)
2024-12-05T22:04:06,072   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-12-05T22:04:06,072   !!

2024-12-05T22:04:06,074           ********************************************************************************
2024-12-05T22:04:06,074           ############################
2024-12-05T22:04:06,075           # Package would be ignored #
2024-12-05T22:04:06,076           ############################
2024-12-05T22:04:06,076           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-12-05T22:04:06,077           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,078           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,079           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-12-05T22:04:06,079           to the `packages` configuration field.

2024-12-05T22:04:06,080           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,081           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,082           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,083           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,084           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,085           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-12-05T22:04:06,086           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-12-05T22:04:06,087           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,087           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,088           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,090           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,090           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,092           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,093                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,093                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,094                 directory, all directories are treated like packages.
2024-12-05T22:04:06,094           ********************************************************************************

2024-12-05T22:04:06,095   !!
2024-12-05T22:04:06,096     check.warn(importable)
2024-12-05T22:04:06,096   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2024-12-05T22:04:06,097   !!

2024-12-05T22:04:06,098           ********************************************************************************
2024-12-05T22:04:06,098           ############################
2024-12-05T22:04:06,099           # Package would be ignored #
2024-12-05T22:04:06,099           ############################
2024-12-05T22:04:06,100           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2024-12-05T22:04:06,100           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,101           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,102           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2024-12-05T22:04:06,103           to the `packages` configuration field.

2024-12-05T22:04:06,104           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,104           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,105           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,106           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,108           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,109           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2024-12-05T22:04:06,110           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2024-12-05T22:04:06,110           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,111           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,112           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,113           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,114           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,116           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,117                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,117                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,118                 directory, all directories are treated like packages.
2024-12-05T22:04:06,119           ********************************************************************************

2024-12-05T22:04:06,120   !!
2024-12-05T22:04:06,121     check.warn(importable)
2024-12-05T22:04:06,122   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-12-05T22:04:06,122   !!

2024-12-05T22:04:06,124           ********************************************************************************
2024-12-05T22:04:06,125           ############################
2024-12-05T22:04:06,125           # Package would be ignored #
2024-12-05T22:04:06,126           ############################
2024-12-05T22:04:06,126           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-12-05T22:04:06,127           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,128           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,129           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-12-05T22:04:06,129           to the `packages` configuration field.

2024-12-05T22:04:06,130           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,131           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,132           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,133           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,134           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,135           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-12-05T22:04:06,136           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-12-05T22:04:06,136           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,137           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,137           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,138           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,140           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,142           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,142                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,143                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,144                 directory, all directories are treated like packages.
2024-12-05T22:04:06,144           ********************************************************************************

2024-12-05T22:04:06,146   !!
2024-12-05T22:04:06,146     check.warn(importable)
2024-12-05T22:04:06,147   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-12-05T22:04:06,148   !!

2024-12-05T22:04:06,149           ********************************************************************************
2024-12-05T22:04:06,150           ############################
2024-12-05T22:04:06,151           # Package would be ignored #
2024-12-05T22:04:06,151           ############################
2024-12-05T22:04:06,152           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-12-05T22:04:06,153           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,154           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,155           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-12-05T22:04:06,156           to the `packages` configuration field.

2024-12-05T22:04:06,157           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,158           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,158           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,160           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,161           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,163           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-12-05T22:04:06,164           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-12-05T22:04:06,164           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,165           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,165           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,166           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,168           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,169           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,170                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,170                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,171                 directory, all directories are treated like packages.
2024-12-05T22:04:06,171           ********************************************************************************

2024-12-05T22:04:06,173   !!
2024-12-05T22:04:06,173     check.warn(importable)
2024-12-05T22:04:06,174   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-12-05T22:04:06,174   !!

2024-12-05T22:04:06,176           ********************************************************************************
2024-12-05T22:04:06,176           ############################
2024-12-05T22:04:06,177           # Package would be ignored #
2024-12-05T22:04:06,178           ############################
2024-12-05T22:04:06,178           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-12-05T22:04:06,179           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,180           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,181           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-12-05T22:04:06,182           to the `packages` configuration field.

2024-12-05T22:04:06,183           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,184           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,185           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,186           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,188           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,189           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-12-05T22:04:06,190           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-12-05T22:04:06,191           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,191           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,192           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,194           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,195           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,197           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,198                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,198                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,199                 directory, all directories are treated like packages.
2024-12-05T22:04:06,200           ********************************************************************************

2024-12-05T22:04:06,202   !!
2024-12-05T22:04:06,203     check.warn(importable)
2024-12-05T22:04:06,203   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-12-05T22:04:06,204   !!

2024-12-05T22:04:06,205           ********************************************************************************
2024-12-05T22:04:06,205           ############################
2024-12-05T22:04:06,206           # Package would be ignored #
2024-12-05T22:04:06,207           ############################
2024-12-05T22:04:06,207           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-12-05T22:04:06,208           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,209           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,209           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-12-05T22:04:06,210           to the `packages` configuration field.

2024-12-05T22:04:06,211           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,212           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,212           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,214           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,215           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,216           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-12-05T22:04:06,217           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-12-05T22:04:06,217           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,218           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,219           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,220           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,222           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,223           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,224                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,224                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,225                 directory, all directories are treated like packages.
2024-12-05T22:04:06,225           ********************************************************************************

2024-12-05T22:04:06,226   !!
2024-12-05T22:04:06,227     check.warn(importable)
2024-12-05T22:04:06,227   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-12-05T22:04:06,228   !!

2024-12-05T22:04:06,229           ********************************************************************************
2024-12-05T22:04:06,230           ############################
2024-12-05T22:04:06,230           # Package would be ignored #
2024-12-05T22:04:06,231           ############################
2024-12-05T22:04:06,231           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-12-05T22:04:06,232           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,233           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,233           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-12-05T22:04:06,234           to the `packages` configuration field.

2024-12-05T22:04:06,235           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,236           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,236           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,237           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,238           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,239           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-12-05T22:04:06,239           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-12-05T22:04:06,240           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,240           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,241           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,241           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,242           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,244           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,245                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,245                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,245                 directory, all directories are treated like packages.
2024-12-05T22:04:06,246           ********************************************************************************

2024-12-05T22:04:06,247   !!
2024-12-05T22:04:06,247     check.warn(importable)
2024-12-05T22:04:06,248   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-12-05T22:04:06,248   !!

2024-12-05T22:04:06,249           ********************************************************************************
2024-12-05T22:04:06,250           ############################
2024-12-05T22:04:06,250           # Package would be ignored #
2024-12-05T22:04:06,251           ############################
2024-12-05T22:04:06,251           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-12-05T22:04:06,252           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,253           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,254           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-12-05T22:04:06,254           to the `packages` configuration field.

2024-12-05T22:04:06,256           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,256           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,257           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,258           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,259           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,261           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-12-05T22:04:06,261           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-12-05T22:04:06,262           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,262           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,263           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,264           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,266           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,269           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,269                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,270                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,271                 directory, all directories are treated like packages.
2024-12-05T22:04:06,272           ********************************************************************************

2024-12-05T22:04:06,274   !!
2024-12-05T22:04:06,274     check.warn(importable)
2024-12-05T22:04:06,275   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-12-05T22:04:06,276   !!

2024-12-05T22:04:06,278           ********************************************************************************
2024-12-05T22:04:06,279           ############################
2024-12-05T22:04:06,280           # Package would be ignored #
2024-12-05T22:04:06,281           ############################
2024-12-05T22:04:06,282           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-12-05T22:04:06,283           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,285           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,286           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-12-05T22:04:06,287           to the `packages` configuration field.

2024-12-05T22:04:06,289           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,291           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,292           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,295           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,298           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,300           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-12-05T22:04:06,301           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-12-05T22:04:06,302           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,304           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,305           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,308           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,311           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,316           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,318                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,320                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,321                 directory, all directories are treated like packages.
2024-12-05T22:04:06,321           ********************************************************************************

2024-12-05T22:04:06,322   !!
2024-12-05T22:04:06,323     check.warn(importable)
2024-12-05T22:04:06,323   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-12-05T22:04:06,324   !!

2024-12-05T22:04:06,325           ********************************************************************************
2024-12-05T22:04:06,326           ############################
2024-12-05T22:04:06,326           # Package would be ignored #
2024-12-05T22:04:06,327           ############################
2024-12-05T22:04:06,327           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-12-05T22:04:06,328           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,329           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,329           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-12-05T22:04:06,330           to the `packages` configuration field.

2024-12-05T22:04:06,331           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,331           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,331           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,332           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,333           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,334           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-12-05T22:04:06,335           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-12-05T22:04:06,335           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,336           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,336           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,337           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,338           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,339           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,340                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,340                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,341                 directory, all directories are treated like packages.
2024-12-05T22:04:06,341           ********************************************************************************

2024-12-05T22:04:06,342   !!
2024-12-05T22:04:06,343     check.warn(importable)
2024-12-05T22:04:06,343   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-12-05T22:04:06,344   !!

2024-12-05T22:04:06,345           ********************************************************************************
2024-12-05T22:04:06,345           ############################
2024-12-05T22:04:06,346           # Package would be ignored #
2024-12-05T22:04:06,347           ############################
2024-12-05T22:04:06,347           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-12-05T22:04:06,348           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,349           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,349           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-12-05T22:04:06,350           to the `packages` configuration field.

2024-12-05T22:04:06,351           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,351           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,352           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,353           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,354           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,355           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-12-05T22:04:06,356           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-12-05T22:04:06,356           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,357           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,357           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,358           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,359           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,360           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,361                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,361                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,362                 directory, all directories are treated like packages.
2024-12-05T22:04:06,362           ********************************************************************************

2024-12-05T22:04:06,363   !!
2024-12-05T22:04:06,363     check.warn(importable)
2024-12-05T22:04:06,364   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-12-05T22:04:06,364   !!

2024-12-05T22:04:06,365           ********************************************************************************
2024-12-05T22:04:06,365           ############################
2024-12-05T22:04:06,366           # Package would be ignored #
2024-12-05T22:04:06,366           ############################
2024-12-05T22:04:06,367           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-12-05T22:04:06,367           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,368           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,369           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-12-05T22:04:06,369           to the `packages` configuration field.

2024-12-05T22:04:06,370           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,371           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,371           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,372           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,373           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,375           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-12-05T22:04:06,375           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-12-05T22:04:06,376           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,376           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,377           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,378           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,379           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,380           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,381                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,381                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,382                 directory, all directories are treated like packages.
2024-12-05T22:04:06,382           ********************************************************************************

2024-12-05T22:04:06,384   !!
2024-12-05T22:04:06,384     check.warn(importable)
2024-12-05T22:04:06,385   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-12-05T22:04:06,385   !!

2024-12-05T22:04:06,386           ********************************************************************************
2024-12-05T22:04:06,387           ############################
2024-12-05T22:04:06,387           # Package would be ignored #
2024-12-05T22:04:06,387           ############################
2024-12-05T22:04:06,388           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-12-05T22:04:06,388           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,389           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,390           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-12-05T22:04:06,390           to the `packages` configuration field.

2024-12-05T22:04:06,391           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,392           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,392           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,393           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,394           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,395           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-12-05T22:04:06,395           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-12-05T22:04:06,396           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,397           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,397           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,398           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,399           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,402           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,402                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,403                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,403                 directory, all directories are treated like packages.
2024-12-05T22:04:06,404           ********************************************************************************

2024-12-05T22:04:06,405   !!
2024-12-05T22:04:06,406     check.warn(importable)
2024-12-05T22:04:06,406   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-12-05T22:04:06,407   !!

2024-12-05T22:04:06,408           ********************************************************************************
2024-12-05T22:04:06,408           ############################
2024-12-05T22:04:06,409           # Package would be ignored #
2024-12-05T22:04:06,409           ############################
2024-12-05T22:04:06,410           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-12-05T22:04:06,410           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,411           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,412           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-12-05T22:04:06,412           to the `packages` configuration field.

2024-12-05T22:04:06,413           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,414           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,415           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,415           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,416           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,417           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-12-05T22:04:06,418           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-12-05T22:04:06,418           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,418           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,419           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,420           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,421           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,422           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,422                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,423                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,423                 directory, all directories are treated like packages.
2024-12-05T22:04:06,424           ********************************************************************************

2024-12-05T22:04:06,425   !!
2024-12-05T22:04:06,425     check.warn(importable)
2024-12-05T22:04:06,426   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-12-05T22:04:06,426   !!

2024-12-05T22:04:06,427           ********************************************************************************
2024-12-05T22:04:06,428           ############################
2024-12-05T22:04:06,428           # Package would be ignored #
2024-12-05T22:04:06,429           ############################
2024-12-05T22:04:06,429           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-12-05T22:04:06,430           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,431           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,431           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-12-05T22:04:06,432           to the `packages` configuration field.

2024-12-05T22:04:06,433           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,434           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,435           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,436           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,437           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,439           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-12-05T22:04:06,439           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-12-05T22:04:06,440           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,441           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,441           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,442           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,444           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,446           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,448                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,449                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,450                 directory, all directories are treated like packages.
2024-12-05T22:04:06,451           ********************************************************************************

2024-12-05T22:04:06,452   !!
2024-12-05T22:04:06,453     check.warn(importable)
2024-12-05T22:04:06,453   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-12-05T22:04:06,454   !!

2024-12-05T22:04:06,454           ********************************************************************************
2024-12-05T22:04:06,455           ############################
2024-12-05T22:04:06,455           # Package would be ignored #
2024-12-05T22:04:06,456           ############################
2024-12-05T22:04:06,456           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-12-05T22:04:06,457           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,457           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,458           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-12-05T22:04:06,458           to the `packages` configuration field.

2024-12-05T22:04:06,460           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,461           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,461           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,462           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,463           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,464           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-12-05T22:04:06,465           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-12-05T22:04:06,465           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,466           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,466           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,468           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,469           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,470           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,471                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,471                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,472                 directory, all directories are treated like packages.
2024-12-05T22:04:06,472           ********************************************************************************

2024-12-05T22:04:06,473   !!
2024-12-05T22:04:06,474     check.warn(importable)
2024-12-05T22:04:06,474   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-12-05T22:04:06,475   !!

2024-12-05T22:04:06,476           ********************************************************************************
2024-12-05T22:04:06,477           ############################
2024-12-05T22:04:06,477           # Package would be ignored #
2024-12-05T22:04:06,478           ############################
2024-12-05T22:04:06,478           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-12-05T22:04:06,479           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,480           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,481           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-12-05T22:04:06,481           to the `packages` configuration field.

2024-12-05T22:04:06,482           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,482           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,483           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,483           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,484           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,485           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-12-05T22:04:06,486           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-12-05T22:04:06,486           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,486           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,487           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,488           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,489           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,490           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,490                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,491                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,491                 directory, all directories are treated like packages.
2024-12-05T22:04:06,492           ********************************************************************************

2024-12-05T22:04:06,493   !!
2024-12-05T22:04:06,493     check.warn(importable)
2024-12-05T22:04:06,494   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-12-05T22:04:06,494   !!

2024-12-05T22:04:06,495           ********************************************************************************
2024-12-05T22:04:06,496           ############################
2024-12-05T22:04:06,496           # Package would be ignored #
2024-12-05T22:04:06,497           ############################
2024-12-05T22:04:06,497           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-12-05T22:04:06,498           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,499           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,499           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-12-05T22:04:06,500           to the `packages` configuration field.

2024-12-05T22:04:06,501           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,501           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,502           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,503           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,504           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,505           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-12-05T22:04:06,505           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-12-05T22:04:06,506           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,506           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,507           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,508           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,509           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,510           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,510                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,511                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,511                 directory, all directories are treated like packages.
2024-12-05T22:04:06,512           ********************************************************************************

2024-12-05T22:04:06,513   !!
2024-12-05T22:04:06,513     check.warn(importable)
2024-12-05T22:04:06,514   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-12-05T22:04:06,514   !!

2024-12-05T22:04:06,515           ********************************************************************************
2024-12-05T22:04:06,515           ############################
2024-12-05T22:04:06,516           # Package would be ignored #
2024-12-05T22:04:06,516           ############################
2024-12-05T22:04:06,517           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-12-05T22:04:06,517           but it is absent from setuptools' `packages` configuration.

2024-12-05T22:04:06,518           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-05T22:04:06,518           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-12-05T22:04:06,519           to the `packages` configuration field.

2024-12-05T22:04:06,520           Alternatively, you can also rely on setuptools' discovery methods
2024-12-05T22:04:06,520           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-05T22:04:06,521           instead of `find_packages(...)`/`find:`).

2024-12-05T22:04:06,521           You can read more about "package discovery" on setuptools documentation page:

2024-12-05T22:04:06,522           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-05T22:04:06,523           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-12-05T22:04:06,524           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-12-05T22:04:06,524           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-05T22:04:06,525           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-05T22:04:06,525           combination with a more fine grained `package-data` configuration.

2024-12-05T22:04:06,526           You can read more about "package data files" on setuptools documentation page:

2024-12-05T22:04:06,527           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-05T22:04:06,529           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-05T22:04:06,529                 even if it does not contain any `.py` files.
2024-12-05T22:04:06,530                 On the other hand, currently there is no concept of package data
2024-12-05T22:04:06,530                 directory, all directories are treated like packages.
2024-12-05T22:04:06,531           ********************************************************************************

2024-12-05T22:04:06,532   !!
2024-12-05T22:04:06,533     check.warn(importable)
2024-12-05T22:04:06,533   creating build/lib/deepspeed/autotuning/config_templates
2024-12-05T22:04:06,534   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-12-05T22:04:06,534   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-12-05T22:04:06,535   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-12-05T22:04:06,536   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-12-05T22:04:06,536   creating build/lib/deepspeed/ops/csrc/adagrad
2024-12-05T22:04:06,537   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-12-05T22:04:06,537   creating build/lib/deepspeed/ops/csrc/adam
2024-12-05T22:04:06,537   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-12-05T22:04:06,538   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-12-05T22:04:06,538   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-12-05T22:04:06,539   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-12-05T22:04:06,539   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-12-05T22:04:06,540   creating build/lib/deepspeed/ops/csrc/aio/common
2024-12-05T22:04:06,541   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-05T22:04:06,541   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-05T22:04:06,542   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-05T22:04:06,543   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-05T22:04:06,543   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-05T22:04:06,544   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-05T22:04:06,546   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,548   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,550   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,551   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,551   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,552   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,552   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,553   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,553   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,554   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,554   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,555   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,555   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,556   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,556   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,557   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,557   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,558   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:06,559   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-12-05T22:04:06,559   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-12-05T22:04:06,559   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-12-05T22:04:06,560   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-12-05T22:04:06,560   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:06,561   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:06,561   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:06,562   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:06,562   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:06,563   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-12-05T22:04:06,563   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-12-05T22:04:06,564   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:06,564   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:06,565   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:06,565   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:06,566   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:06,566   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:06,567   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:06,567   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:06,568   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:06,568   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:06,569   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:06,569   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:06,570   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:06,570   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:06,571   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:06,571   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:06,572   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:06,572   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:06,573   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:06,573   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:06,574   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:06,574   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:06,575   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:06,575   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:06,576   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:06,576   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:06,577   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:06,577   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:06,578   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-05T22:04:06,578   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-05T22:04:06,579   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-05T22:04:06,579   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-12-05T22:04:06,580   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-12-05T22:04:06,580   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-12-05T22:04:06,581   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-12-05T22:04:06,581   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-12-05T22:04:06,582   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-12-05T22:04:06,582   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:06,583   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:06,583   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:06,584   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:06,585   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:06,585   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:06,586   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:06,587   creating build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,587   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,587   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,588   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,588   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,589   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,589   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,590   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,590   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,591   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,591   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,592   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,593   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,593   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,594   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,595   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,595   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,596   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,597   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,597   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,598   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,598   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,599   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,600   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,601   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,601   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,602   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,603   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,605   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,608   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-05T22:04:06,611   creating build/lib/deepspeed/ops/csrc/lamb
2024-12-05T22:04:06,613   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-12-05T22:04:06,616   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-12-05T22:04:06,620   creating build/lib/deepspeed/ops/csrc/lion
2024-12-05T22:04:06,621   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-12-05T22:04:06,623   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-12-05T22:04:06,626   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-12-05T22:04:06,628   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-12-05T22:04:06,630   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-12-05T22:04:06,633   creating build/lib/deepspeed/ops/csrc/quantization
2024-12-05T22:04:06,634   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-05T22:04:06,636   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-05T22:04:06,639   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-12-05T22:04:06,642   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-05T22:04:06,644   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-05T22:04:06,647   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-05T22:04:06,649   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-05T22:04:06,652   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:06,653   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:06,655   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:06,658   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:06,661   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:06,663   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-12-05T22:04:06,664   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-12-05T22:04:06,667   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-12-05T22:04:06,668   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-12-05T22:04:06,671   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-12-05T22:04:06,673   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-12-05T22:04:06,674   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-12-05T22:04:06,677   creating build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,678   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,681   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,684   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,688   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,691   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,694   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,698   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,701   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-05T22:04:06,704   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,706   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,708   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,711   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,714   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,717   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,719   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,723   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,726   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,728   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,731   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:06,735   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-12-05T22:04:06,736   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-12-05T22:04:06,740   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-12-05T22:04:06,745   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-12-05T22:04:06,751   creating build/lib/deepspeed/ops/csrc/utils
2024-12-05T22:04:06,753   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-12-05T22:04:06,756   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-12-05T22:04:06,758   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-12-05T22:04:06,762   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-12-05T22:04:06,764   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-12-05T22:04:06,769   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-12-05T22:04:06,772   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-12-05T22:04:06,775   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-12-05T22:04:06,776   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-12-05T22:04:06,778   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:06,779   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:06,781   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:06,784   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:06,786   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:06,789   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:06,791   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-12-05T22:04:06,792   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-12-05T22:04:06,795   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-12-05T22:04:06,796   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-12-05T22:04:06,798   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-12-05T22:04:06,800   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-12-05T22:04:06,801   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-12-05T22:04:06,803   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:06,805   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:06,807   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:06,809   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:06,811   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:06,815   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:06,818   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-12-05T22:04:06,820   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-12-05T22:04:06,821   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-12-05T22:04:06,824   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-12-05T22:04:06,826   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-12-05T22:04:06,827   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-12-05T22:04:06,829   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-05T22:04:06,831   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-05T22:04:06,833   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-05T22:04:06,835   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-05T22:04:06,838   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-12-05T22:04:06,840   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:06,842   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:06,847   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:06,849   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:06,851   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:06,854   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:06,856   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:06,859   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:06,861   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:06,863   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:06,865   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:06,867   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:06,869   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:06,871   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:06,874   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:06,876   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:06,879   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:06,881   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:06,883   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:06,885   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:06,887   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:06,898   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:06,905   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:06,907   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:06,910   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:06,912   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:06,914   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:06,917   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:06,919   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:06,922   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:06,924   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:06,927   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:06,930   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:06,933   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:06,935   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:06,938   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:06,941   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:06,944   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:06,946   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:06,949   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:06,952   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:06,955   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:06,959   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:06,962   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:06,965   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:06,968   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,969   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,972   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,976   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,979   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,982   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,985   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,988   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,991   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,994   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:06,998   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:07,001   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:07,003   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:07,007   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:07,010   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:07,012   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:07,015   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:07,018   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:07,021   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:07,024   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:07,027   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:07,030   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:07,082   running build_scripts
2024-12-05T22:04:07,083   creating build/scripts-3.11
2024-12-05T22:04:07,084   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-12-05T22:04:07,086   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-12-05T22:04:07,087   copying and adjusting bin/ds -> build/scripts-3.11
2024-12-05T22:04:07,089   copying bin/ds_ssh -> build/scripts-3.11
2024-12-05T22:04:07,091   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-12-05T22:04:07,092   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-12-05T22:04:07,094   copying and adjusting bin/dsr -> build/scripts-3.11
2024-12-05T22:04:07,096   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-12-05T22:04:07,097   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2024-12-05T22:04:07,099   copying and adjusting bin/ds_io -> build/scripts-3.11
2024-12-05T22:04:07,100   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-12-05T22:04:07,100   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-12-05T22:04:07,101   changing mode of build/scripts-3.11/ds from 644 to 755
2024-12-05T22:04:07,101   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-12-05T22:04:07,102   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-12-05T22:04:07,102   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-12-05T22:04:07,103   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-12-05T22:04:07,103   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2024-12-05T22:04:07,104   changing mode of build/scripts-3.11/ds_io from 644 to 755
2024-12-05T22:04:07,131   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-12-05T22:04:07,131   !!

2024-12-05T22:04:07,133           ********************************************************************************
2024-12-05T22:04:07,133           Please avoid running ``setup.py`` directly.
2024-12-05T22:04:07,133           Instead, use pypa/build, pypa/installer or other
2024-12-05T22:04:07,134           standards-based tools.

2024-12-05T22:04:07,135           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-12-05T22:04:07,135           ********************************************************************************

2024-12-05T22:04:07,136   !!
2024-12-05T22:04:07,137     self.initialize_options()
2024-12-05T22:04:07,158   installing to build/bdist.linux-armv7l/wheel
2024-12-05T22:04:07,158   running install
2024-12-05T22:04:07,185   running install_lib
2024-12-05T22:04:07,213   creating build/bdist.linux-armv7l/wheel
2024-12-05T22:04:07,215   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-12-05T22:04:07,217   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-12-05T22:04:07,218   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-12-05T22:04:07,221   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-12-05T22:04:07,222   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-12-05T22:04:07,224   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-12-05T22:04:07,226   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-12-05T22:04:07,227   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-12-05T22:04:07,229   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-12-05T22:04:07,231   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-12-05T22:04:07,234   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-12-05T22:04:07,235   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,237   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,239   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,240   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,242   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,244   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,246   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,248   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,250   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,251   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-05T22:04:07,254   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-12-05T22:04:07,255   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,257   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,259   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,262   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,264   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,267   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,268   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,271   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,273   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,275   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,277   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,279   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,281   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,283   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,284   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,286   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,289   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,292   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-05T22:04:07,294   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-05T22:04:07,297   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-12-05T22:04:07,298   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,301   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-12-05T22:04:07,302   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,304   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,307   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,309   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,311   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,313   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,315   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,318   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,321   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,324   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,326   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,329   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,331   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-12-05T22:04:07,332   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-05T22:04:07,335   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-05T22:04:07,337   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-05T22:04:07,339   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-05T22:04:07,341   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-05T22:04:07,343   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-05T22:04:07,345   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-05T22:04:07,347   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,349   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,351   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,353   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,355   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,357   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,359   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-05T22:04:07,361   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,363   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,365   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,366   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,368   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,370   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,373   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,374   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,377   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,379   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,382   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,384   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-05T22:04:07,388   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-12-05T22:04:07,389   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,392   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,394   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,396   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,399   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,401   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,403   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,406   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,408   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,410   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-05T22:04:07,414   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-12-05T22:04:07,416   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-12-05T22:04:07,418   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-12-05T22:04:07,420   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-12-05T22:04:07,422   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-05T22:04:07,425   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-12-05T22:04:07,426   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,429   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,432   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,435   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,437   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,440   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,442   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,445   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,447   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,450   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-05T22:04:07,454   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-12-05T22:04:07,456   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:07,458   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:07,460   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:07,462   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:07,464   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-12-05T22:04:07,466   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,469   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-12-05T22:04:07,470   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-12-05T22:04:07,473   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:07,475   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:07,477   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:07,480   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:07,482   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:07,484   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-05T22:04:07,486   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-12-05T22:04:07,488   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-12-05T22:04:07,491   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-12-05T22:04:07,494   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:07,495   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:07,497   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:07,500   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:07,502   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:07,504   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-05T22:04:07,507   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,511   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-12-05T22:04:07,512   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-12-05T22:04:07,514   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-12-05T22:04:07,517   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-12-05T22:04:07,519   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,521   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,524   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,527   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,529   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,532   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-12-05T22:04:07,534   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-12-05T22:04:07,536   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-12-05T22:04:07,538   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-12-05T22:04:07,540   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-12-05T22:04:07,543   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-12-05T22:04:07,544   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-12-05T22:04:07,546   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-12-05T22:04:07,549   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-12-05T22:04:07,551   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-12-05T22:04:07,554   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,555   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,560   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,563   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,565   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,567   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,569   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,571   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,573   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,575   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,578   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,580   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,581   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,583   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-05T22:04:07,586   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-12-05T22:04:07,587   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-05T22:04:07,590   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-05T22:04:07,592   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-05T22:04:07,595   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-05T22:04:07,598   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-05T22:04:07,600   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-05T22:04:07,603   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2024-12-05T22:04:07,604   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2024-12-05T22:04:07,607   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2024-12-05T22:04:07,609   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,612   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,615   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,618   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,620   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,623   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,626   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-12-05T22:04:07,628   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-12-05T22:04:07,630   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-12-05T22:04:07,632   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-05T22:04:07,635   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-12-05T22:04:07,636   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-05T22:04:07,638   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-05T22:04:07,641   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-05T22:04:07,643   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-05T22:04:07,646   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-05T22:04:07,649   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-05T22:04:07,652   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-12-05T22:04:07,654   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,657   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,660   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,662   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,665   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,669   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,672   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,674   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,676   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,678   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,681   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,683   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,685   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,688   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,690   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,694   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,699   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-05T22:04:07,701   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-05T22:04:07,704   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2024-12-05T22:04:07,705   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,707   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,709   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,711   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,713   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,715   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,717   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,719   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,721   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,724   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,726   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,728   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-05T22:04:07,730   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-12-05T22:04:07,731   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-05T22:04:07,734   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-05T22:04:07,736   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-05T22:04:07,738   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-05T22:04:07,741   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-05T22:04:07,744   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-05T22:04:07,746   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-05T22:04:07,748   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-05T22:04:07,751   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-12-05T22:04:07,754   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-12-05T22:04:07,756   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-12-05T22:04:07,758   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-12-05T22:04:07,760   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-12-05T22:04:07,763   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-12-05T22:04:07,765   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-05T22:04:07,770   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-05T22:04:07,773   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-05T22:04:07,779   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-05T22:04:07,783   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-05T22:04:07,786   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-05T22:04:07,789   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-12-05T22:04:07,791   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-05T22:04:07,794   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-05T22:04:07,797   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-05T22:04:07,799   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-05T22:04:07,802   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-05T22:04:07,804   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-05T22:04:07,807   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-12-05T22:04:07,809   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-05T22:04:07,812   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-05T22:04:07,816   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-05T22:04:07,818   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-05T22:04:07,820   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-05T22:04:07,823   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-05T22:04:07,826   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-12-05T22:04:07,828   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-12-05T22:04:07,831   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-12-05T22:04:07,832   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-12-05T22:04:07,834   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-12-05T22:04:07,837   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-12-05T22:04:07,840   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-12-05T22:04:07,842   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-12-05T22:04:07,843   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-05T22:04:07,846   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-05T22:04:07,847   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-05T22:04:07,850   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-05T22:04:07,851   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-05T22:04:07,854   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-12-05T22:04:07,856   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-12-05T22:04:07,857   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:07,860   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-12-05T22:04:07,861   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:07,863   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:07,865   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:07,867   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:07,870   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-12-05T22:04:07,872   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:07,873   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:07,875   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:07,877   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:07,879   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-12-05T22:04:07,882   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:07,883   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:07,885   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:07,886   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:07,888   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-12-05T22:04:07,890   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-05T22:04:07,893   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-05T22:04:07,895   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-05T22:04:07,898   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:07,899   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:07,901   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:07,903   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:07,905   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-12-05T22:04:07,907   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-05T22:04:07,910   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:07,911   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:07,913   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:07,915   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:07,917   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-05T22:04:07,919   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-05T22:04:07,921   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-05T22:04:07,925   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:07,926   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:07,928   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:07,929   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:07,931   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-12-05T22:04:07,934   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:07,935   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:07,937   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:07,939   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:07,941   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-12-05T22:04:07,943   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-05T22:04:07,946   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,947   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,949   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,951   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,953   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,955   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,957   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,958   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,960   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,963   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-05T22:04:07,966   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:07,967   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:07,969   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:07,971   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:07,973   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-12-05T22:04:07,975   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:07,977   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:07,978   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:07,980   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:07,983   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-05T22:04:07,985   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:07,986   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:07,988   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:07,990   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:07,992   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-12-05T22:04:07,995   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:07,996   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:07,998   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:08,000   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:08,002   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:08,004   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:08,005   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:08,007   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:08,009   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:08,010   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-05T22:04:08,013   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-12-05T22:04:08,014   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-12-05T22:04:08,016   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-12-05T22:04:08,017   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-12-05T22:04:08,019   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-12-05T22:04:08,022   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-12-05T22:04:08,023   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-12-05T22:04:08,026   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,027   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,029   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,031   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,033   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,035   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,037   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,039   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,041   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-05T22:04:08,042   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-12-05T22:04:08,044   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-12-05T22:04:08,046   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-12-05T22:04:08,048   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-12-05T22:04:08,050   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-12-05T22:04:08,051   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-12-05T22:04:08,053   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-12-05T22:04:08,056   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-12-05T22:04:08,058   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-12-05T22:04:08,059   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-12-05T22:04:08,061   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-12-05T22:04:08,063   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-12-05T22:04:08,066   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-05T22:04:08,067   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-05T22:04:08,069   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-05T22:04:08,071   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-05T22:04:08,073   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-12-05T22:04:08,075   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-12-05T22:04:08,077   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-12-05T22:04:08,079   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-12-05T22:04:08,080   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-12-05T22:04:08,083   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-12-05T22:04:08,085   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-12-05T22:04:08,087   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-12-05T22:04:08,089   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-12-05T22:04:08,092   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-12-05T22:04:08,093   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-12-05T22:04:08,095   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-12-05T22:04:08,098   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-12-05T22:04:08,099   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-05T22:04:08,101   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-05T22:04:08,102   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-05T22:04:08,104   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-05T22:04:08,106   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-05T22:04:08,108   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-05T22:04:08,109   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-05T22:04:08,111   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:08,113   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:08,115   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:08,117   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:08,119   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:08,122   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-12-05T22:04:08,123   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-05T22:04:08,126   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-05T22:04:08,128   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-05T22:04:08,131   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-12-05T22:04:08,133   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-12-05T22:04:08,135   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-12-05T22:04:08,138   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-05T22:04:08,140   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-05T22:04:08,143   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-05T22:04:08,145   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-05T22:04:08,148   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-12-05T22:04:08,149   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-12-05T22:04:08,151   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-12-05T22:04:08,153   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-12-05T22:04:08,155   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:08,157   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:08,159   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:08,160   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:08,162   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:08,164   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:08,166   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-05T22:04:08,168   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-12-05T22:04:08,170   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:08,171   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:08,173   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:08,175   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:08,177   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:08,179   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-05T22:04:08,181   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-12-05T22:04:08,183   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-12-05T22:04:08,185   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-12-05T22:04:08,187   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-12-05T22:04:08,189   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-12-05T22:04:08,190   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-12-05T22:04:08,193   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:08,194   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:08,196   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:08,198   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:08,199   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:08,201   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:08,203   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-05T22:04:08,206   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:08,207   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:08,209   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:08,211   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:08,213   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:08,215   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:08,217   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-05T22:04:08,219   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:08,220   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:08,222   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:08,224   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:08,226   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-05T22:04:08,228   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-05T22:04:08,229   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-05T22:04:08,231   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-05T22:04:08,233   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-05T22:04:08,236   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:08,237   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:08,239   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:08,240   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:08,242   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:08,244   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:08,245   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-05T22:04:08,248   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,249   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,251   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,252   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,254   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,256   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,259   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,261   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,263   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-05T22:04:08,266   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:08,267   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:08,269   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:08,271   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:08,273   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:08,276   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:08,278   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-05T22:04:08,279   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-12-05T22:04:08,282   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:08,283   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:08,285   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:08,287   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:08,290   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:08,291   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:08,293   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-05T22:04:08,297   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:08,298   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:08,300   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:08,302   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:08,304   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:08,306   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:08,307   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-05T22:04:08,310   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-12-05T22:04:08,311   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-12-05T22:04:08,313   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-12-05T22:04:08,316   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-12-05T22:04:08,317   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-12-05T22:04:08,319   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-12-05T22:04:08,321   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:08,323   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:08,325   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:08,327   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:08,329   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:08,332   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-05T22:04:08,334   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:08,336   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:08,338   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:08,340   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:08,342   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-05T22:04:08,345   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:08,346   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:08,348   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:08,350   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:08,353   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:08,355   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:08,358   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,359   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,362   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,364   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,366   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,368   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,371   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,373   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,375   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,377   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-05T22:04:08,379   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-05T22:04:08,382   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:08,383   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:08,385   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:08,387   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:08,388   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:08,390   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:08,392   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:08,395   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-05T22:04:08,397   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:08,399   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:08,401   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:08,403   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:08,406   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:08,408   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-05T22:04:08,411   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,412   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,415   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,417   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,419   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,421   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,423   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,426   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,428   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-05T22:04:08,430   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:08,431   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:08,434   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:08,436   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:08,439   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:08,441   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-05T22:04:08,444   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:08,446   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:08,448   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-05T22:04:08,450   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-12-05T22:04:08,454   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-12-05T22:04:08,455   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-05T22:04:08,458   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-05T22:04:08,460   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-05T22:04:08,462   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-05T22:04:08,464   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-05T22:04:08,466   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-12-05T22:04:08,467   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-12-05T22:04:08,470   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-12-05T22:04:08,471   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-12-05T22:04:08,473   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-12-05T22:04:08,475   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-12-05T22:04:08,478   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-12-05T22:04:08,479   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-12-05T22:04:08,482   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-12-05T22:04:08,484   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-12-05T22:04:08,485   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-05T22:04:08,487   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-05T22:04:08,489   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-05T22:04:08,491   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-05T22:04:08,493   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-05T22:04:08,496   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-05T22:04:08,499   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-05T22:04:08,501   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-12-05T22:04:08,502   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-05T22:04:08,505   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-05T22:04:08,507   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-05T22:04:08,510   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-05T22:04:08,512   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-05T22:04:08,514   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-05T22:04:08,517   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-05T22:04:08,520   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-05T22:04:08,523   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-12-05T22:04:08,524   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-05T22:04:08,527   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-05T22:04:08,528   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-05T22:04:08,532   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-05T22:04:08,534   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-05T22:04:08,537   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-05T22:04:08,539   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-05T22:04:08,543   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-12-05T22:04:08,545   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,547   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,550   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,552   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,555   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,559   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,561   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,563   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,566   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-05T22:04:08,570   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-12-05T22:04:08,573   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-12-05T22:04:08,575   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,577   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,580   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,582   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,586   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,588   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,590   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,593   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,595   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,598   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,600   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-05T22:04:08,603   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,605   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,608   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,610   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,613   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,615   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,619   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,621   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,624   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,626   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,628   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,631   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,634   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-12-05T22:04:08,635   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-05T22:04:08,638   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-05T22:04:08,640   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-05T22:04:08,642   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-05T22:04:08,644   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-05T22:04:08,646   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-05T22:04:08,647   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,649   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,652   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,653   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,655   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2024-12-05T22:04:08,657   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-05T22:04:08,659   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-05T22:04:08,660   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-05T22:04:08,662   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-05T22:04:08,664   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-05T22:04:08,666   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-05T22:04:08,668   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,671   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,673   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,675   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,676   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,678   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,681   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,684   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,686   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,688   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,690   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,693   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,696   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,699   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,705   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,709   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-05T22:04:08,711   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,712   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-05T22:04:08,715   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-12-05T22:04:08,716   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-05T22:04:08,718   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-05T22:04:08,720   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-05T22:04:08,722   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-05T22:04:08,723   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-05T22:04:08,725   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-05T22:04:08,727   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-05T22:04:08,730   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-12-05T22:04:08,731   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-12-05T22:04:08,733   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-12-05T22:04:08,735   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-12-05T22:04:08,737   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-12-05T22:04:08,739   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-12-05T22:04:08,742   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-12-05T22:04:08,743   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-12-05T22:04:08,744   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-12-05T22:04:08,747   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2024-12-05T22:04:08,749   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2024-12-05T22:04:08,751   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-12-05T22:04:08,752   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-12-05T22:04:08,754   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-12-05T22:04:08,757   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-12-05T22:04:08,758   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-12-05T22:04:08,760   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-12-05T22:04:08,762   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-12-05T22:04:08,764   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-12-05T22:04:08,766   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-12-05T22:04:08,767   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-12-05T22:04:08,769   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-12-05T22:04:08,772   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-12-05T22:04:08,774   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-12-05T22:04:08,776   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-12-05T22:04:08,777   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-12-05T22:04:08,780   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-12-05T22:04:08,781   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-12-05T22:04:08,784   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-12-05T22:04:08,785   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-12-05T22:04:08,788   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-12-05T22:04:08,789   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-12-05T22:04:08,791   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-12-05T22:04:08,793   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-12-05T22:04:08,796   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:08,803   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:08,806   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:08,808   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:08,810   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:08,812   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-05T22:04:08,815   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-12-05T22:04:08,816   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-12-05T22:04:08,819   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-12-05T22:04:08,820   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-12-05T22:04:08,822   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-12-05T22:04:08,824   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-12-05T22:04:08,827   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-12-05T22:04:08,828   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-12-05T22:04:08,830   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-12-05T22:04:08,831   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-05T22:04:08,834   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-05T22:04:08,836   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-05T22:04:08,839   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-05T22:04:08,842   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-05T22:04:08,845   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-05T22:04:08,848   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-05T22:04:08,852   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-12-05T22:04:08,854   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-05T22:04:08,856   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-05T22:04:08,859   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-05T22:04:08,862   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-05T22:04:08,865   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-05T22:04:08,868   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-12-05T22:04:08,870   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-12-05T22:04:08,872   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-12-05T22:04:08,876   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2024-12-05T22:04:08,878   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:08,880   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:08,882   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:08,885   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:08,887   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:08,890   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:08,892   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-05T22:04:08,896   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-12-05T22:04:08,898   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:08,899   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:08,904   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:08,907   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:08,909   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:08,912   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:08,913   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:08,915   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:08,918   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:08,920   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:08,924   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:08,926   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:08,929   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-05T22:04:08,931   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:08,935   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-05T22:04:08,936   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-05T22:04:08,939   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-05T22:04:08,941   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-05T22:04:08,944   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:08,945   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:08,948   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:08,949   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:08,952   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:08,957   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:08,960   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:08,964   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-05T22:04:08,967   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:08,968   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:08,971   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:08,973   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:08,976   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-05T22:04:08,980   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-12-05T22:04:08,981   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-12-05T22:04:08,983   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-12-05T22:04:08,986   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:08,987   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:08,990   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:08,992   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:08,994   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:08,996   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:08,997   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:08,999   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,002   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,003   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,005   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,007   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,009   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,011   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,013   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,015   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,017   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,019   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-05T22:04:09,022   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-12-05T22:04:09,023   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-05T22:04:09,025   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-05T22:04:09,027   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-05T22:04:09,029   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-05T22:04:09,031   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-05T22:04:09,034   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-05T22:04:09,036   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:09,038   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:09,040   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:09,042   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:09,045   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-12-05T22:04:09,048   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-12-05T22:04:09,049   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-12-05T22:04:09,052   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,053   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,056   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,059   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,062   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,065   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,069   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-12-05T22:04:09,071   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,072   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,075   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,078   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,081   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,083   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,086   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,088   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,090   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,092   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,096   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-05T22:04:09,099   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-12-05T22:04:09,100   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-12-05T22:04:09,103   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-12-05T22:04:09,106   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-12-05T22:04:09,108   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,111   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,114   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-05T22:04:09,117   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-12-05T22:04:09,118   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-05T22:04:09,120   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-05T22:04:09,122   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-05T22:04:09,124   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-05T22:04:09,126   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-05T22:04:09,129   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-12-05T22:04:09,130   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-12-05T22:04:09,133   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-12-05T22:04:09,134   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-12-05T22:04:09,136   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-12-05T22:04:09,140   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-12-05T22:04:09,141   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-12-05T22:04:09,143   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-12-05T22:04:09,147   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-12-05T22:04:09,148   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,150   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,152   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,154   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,156   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,159   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,160   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,163   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,166   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,168   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,170   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,172   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,174   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,177   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,178   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,180   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,183   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,185   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,187   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,190   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,192   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,194   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,196   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,198   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,201   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,203   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,206   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,209   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,211   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-05T22:04:09,215   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-12-05T22:04:09,217   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-12-05T22:04:09,219   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-12-05T22:04:09,222   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-12-05T22:04:09,223   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-12-05T22:04:09,226   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:09,228   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:09,231   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:09,234   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:09,237   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-12-05T22:04:09,239   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-12-05T22:04:09,241   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-12-05T22:04:09,243   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-12-05T22:04:09,245   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-12-05T22:04:09,246   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-12-05T22:04:09,249   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-12-05T22:04:09,251   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-12-05T22:04:09,254   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,255   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,257   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,259   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,262   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,263   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,266   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,268   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,270   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,272   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,275   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-05T22:04:09,277   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,279   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,281   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,283   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,285   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,288   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,290   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,293   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,294   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,296   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,298   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,300   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,302   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,304   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,306   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,308   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,310   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,312   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,314   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,315   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,317   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,319   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,321   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,323   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,325   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,327   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,329   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,331   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,333   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,335   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,337   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-05T22:04:09,339   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,342   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,344   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-05T22:04:09,348   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-12-05T22:04:09,349   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-12-05T22:04:09,352   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-12-05T22:04:09,354   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-12-05T22:04:09,356   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-12-05T22:04:09,359   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-12-05T22:04:09,361   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-05T22:04:09,364   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-05T22:04:09,368   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:09,369   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:09,372   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:09,374   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:09,376   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-12-05T22:04:09,380   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-05T22:04:09,382   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-05T22:04:09,385   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-05T22:04:09,388   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-05T22:04:09,390   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-05T22:04:09,395   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-12-05T22:04:09,397   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-12-05T22:04:09,399   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-12-05T22:04:09,402   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-12-05T22:04:09,405   running install_egg_info
2024-12-05T22:04:09,449   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.1-py3.11.egg-info
2024-12-05T22:04:09,463   running install_scripts
2024-12-05T22:04:09,465   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,466   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,468   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,470   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,472   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,473   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,475   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,477   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,479   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,480   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,482   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts
2024-12-05T22:04:09,484   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/ds_report to 755
2024-12-05T22:04:09,484   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/deepspeed to 755
2024-12-05T22:04:09,485   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/ds_nvme_tune to 755
2024-12-05T22:04:09,485   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/deepspeed.pt to 755
2024-12-05T22:04:09,486   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/ds_elastic to 755
2024-12-05T22:04:09,486   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/ds_bench to 755
2024-12-05T22:04:09,487   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/dsr to 755
2024-12-05T22:04:09,487   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/ds to 755
2024-12-05T22:04:09,488   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/ds_ssh to 755
2024-12-05T22:04:09,489   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.data/scripts/ds_io to 755
2024-12-05T22:04:09,538   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.1.dist-info/WHEEL
2024-12-05T22:04:09,541   creating '/tmp/pip-wheel-e26rodfj/deepspeed-0.16.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-12-05T22:04:09,544   adding 'deepspeed/__init__.py'
2024-12-05T22:04:09,546   adding 'deepspeed/constants.py'
2024-12-05T22:04:09,548   adding 'deepspeed/env_report.py'
2024-12-05T22:04:09,549   adding 'deepspeed/git_version_info.py'
2024-12-05T22:04:09,550   adding 'deepspeed/git_version_info_installed.py'
2024-12-05T22:04:09,552   adding 'deepspeed/accelerator/__init__.py'
2024-12-05T22:04:09,554   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-12-05T22:04:09,556   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-12-05T22:04:09,558   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-12-05T22:04:09,560   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-12-05T22:04:09,562   adding 'deepspeed/accelerator/mlu_accelerator.py'
2024-12-05T22:04:09,563   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-12-05T22:04:09,566   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-12-05T22:04:09,568   adding 'deepspeed/accelerator/real_accelerator.py'
2024-12-05T22:04:09,570   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-12-05T22:04:09,572   adding 'deepspeed/autotuning/__init__.py'
2024-12-05T22:04:09,578   adding 'deepspeed/autotuning/autotuner.py'
2024-12-05T22:04:09,579   adding 'deepspeed/autotuning/config.py'
2024-12-05T22:04:09,581   adding 'deepspeed/autotuning/constants.py'
2024-12-05T22:04:09,583   adding 'deepspeed/autotuning/scheduler.py'
2024-12-05T22:04:09,585   adding 'deepspeed/autotuning/utils.py'
2024-12-05T22:04:09,587   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-12-05T22:04:09,588   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-12-05T22:04:09,589   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-12-05T22:04:09,590   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-12-05T22:04:09,592   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-12-05T22:04:09,593   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-12-05T22:04:09,594   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-12-05T22:04:09,596   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-12-05T22:04:09,597   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-12-05T22:04:09,598   adding 'deepspeed/autotuning/tuner/utils.py'
2024-12-05T22:04:09,600   adding 'deepspeed/checkpoint/__init__.py'
2024-12-05T22:04:09,601   adding 'deepspeed/checkpoint/constants.py'
2024-12-05T22:04:09,603   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-12-05T22:04:09,606   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-12-05T22:04:09,607   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-12-05T22:04:09,609   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-12-05T22:04:09,611   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-12-05T22:04:09,612   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-12-05T22:04:09,614   adding 'deepspeed/checkpoint/utils.py'
2024-12-05T22:04:09,615   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-12-05T22:04:09,617   adding 'deepspeed/comm/__init__.py'
2024-12-05T22:04:09,618   adding 'deepspeed/comm/backend.py'
2024-12-05T22:04:09,620   adding 'deepspeed/comm/ccl.py'
2024-12-05T22:04:09,624   adding 'deepspeed/comm/comm.py'
2024-12-05T22:04:09,625   adding 'deepspeed/comm/config.py'
2024-12-05T22:04:09,627   adding 'deepspeed/comm/constants.py'
2024-12-05T22:04:09,628   adding 'deepspeed/comm/reduce_op.py'
2024-12-05T22:04:09,630   adding 'deepspeed/comm/torch.py'
2024-12-05T22:04:09,631   adding 'deepspeed/comm/utils.py'
2024-12-05T22:04:09,633   adding 'deepspeed/compression/__init__.py'
2024-12-05T22:04:09,637   adding 'deepspeed/compression/basic_layer.py'
2024-12-05T22:04:09,639   adding 'deepspeed/compression/compress.py'
2024-12-05T22:04:09,641   adding 'deepspeed/compression/config.py'
2024-12-05T22:04:09,642   adding 'deepspeed/compression/constants.py'
2024-12-05T22:04:09,644   adding 'deepspeed/compression/helper.py'
2024-12-05T22:04:09,646   adding 'deepspeed/compression/scheduler.py'
2024-12-05T22:04:09,648   adding 'deepspeed/compression/utils.py'
2024-12-05T22:04:09,650   adding 'deepspeed/elasticity/__init__.py'
2024-12-05T22:04:09,652   adding 'deepspeed/elasticity/config.py'
2024-12-05T22:04:09,654   adding 'deepspeed/elasticity/constants.py'
2024-12-05T22:04:09,655   adding 'deepspeed/elasticity/elastic_agent.py'
2024-12-05T22:04:09,658   adding 'deepspeed/elasticity/elasticity.py'
2024-12-05T22:04:09,660   adding 'deepspeed/elasticity/utils.py'
2024-12-05T22:04:09,662   adding 'deepspeed/inference/__init__.py'
2024-12-05T22:04:09,664   adding 'deepspeed/inference/config.py'
2024-12-05T22:04:09,668   adding 'deepspeed/inference/engine.py'
2024-12-05T22:04:09,670   adding 'deepspeed/inference/quantization/__init__.py'
2024-12-05T22:04:09,672   adding 'deepspeed/inference/quantization/layers.py'
2024-12-05T22:04:09,674   adding 'deepspeed/inference/quantization/quantization.py'
2024-12-05T22:04:09,675   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-12-05T22:04:09,678   adding 'deepspeed/inference/quantization/utils.py'
2024-12-05T22:04:09,680   adding 'deepspeed/inference/v2/__init__.py'
2024-12-05T22:04:09,681   adding 'deepspeed/inference/v2/allocator.py'
2024-12-05T22:04:09,683   adding 'deepspeed/inference/v2/config_v2.py'
2024-12-05T22:04:09,685   adding 'deepspeed/inference/v2/engine_factory.py'
2024-12-05T22:04:09,687   adding 'deepspeed/inference/v2/engine_v2.py'
2024-12-05T22:04:09,689   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-12-05T22:04:09,691   adding 'deepspeed/inference/v2/inference_utils.py'
2024-12-05T22:04:09,693   adding 'deepspeed/inference/v2/logging.py'
2024-12-05T22:04:09,695   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-12-05T22:04:09,699   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-12-05T22:04:09,701   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-12-05T22:04:09,703   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-12-05T22:04:09,706   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-12-05T22:04:09,710   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-12-05T22:04:09,713   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-12-05T22:04:09,718   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-12-05T22:04:09,721   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-12-05T22:04:09,723   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-12-05T22:04:09,725   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-12-05T22:04:09,726   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-12-05T22:04:09,728   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-12-05T22:04:09,729   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-12-05T22:04:09,732   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-12-05T22:04:09,734   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-12-05T22:04:09,736   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-12-05T22:04:09,738   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-12-05T22:04:09,786   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-12-05T22:04:09,787   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-12-05T22:04:09,788   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-12-05T22:04:09,789   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-12-05T22:04:09,791   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-12-05T22:04:09,792   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-12-05T22:04:09,794   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-12-05T22:04:09,796   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-12-05T22:04:09,797   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-12-05T22:04:09,799   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-12-05T22:04:09,801   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-12-05T22:04:09,802   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-12-05T22:04:09,804   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-12-05T22:04:09,806   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-12-05T22:04:09,808   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-12-05T22:04:09,810   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-12-05T22:04:09,811   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-12-05T22:04:09,813   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-12-05T22:04:09,814   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-12-05T22:04:09,816   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-12-05T22:04:09,818   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-12-05T22:04:09,819   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-12-05T22:04:09,821   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-12-05T22:04:09,823   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-12-05T22:04:09,824   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-12-05T22:04:09,825   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-12-05T22:04:09,826   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-12-05T22:04:09,828   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-12-05T22:04:09,830   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-12-05T22:04:09,831   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-12-05T22:04:09,832   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-12-05T22:04:09,834   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-12-05T22:04:09,835   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-12-05T22:04:09,836   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-12-05T22:04:09,838   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-12-05T22:04:09,839   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-12-05T22:04:09,840   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-12-05T22:04:09,842   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-12-05T22:04:09,843   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-12-05T22:04:09,844   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-12-05T22:04:09,846   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-12-05T22:04:09,847   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-12-05T22:04:09,849   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-12-05T22:04:09,850   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-12-05T22:04:09,852   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-12-05T22:04:09,853   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-12-05T22:04:09,855   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-12-05T22:04:09,856   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-12-05T22:04:09,858   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-12-05T22:04:09,860   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-12-05T22:04:09,861   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-12-05T22:04:09,862   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-12-05T22:04:09,865   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-12-05T22:04:09,868   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-12-05T22:04:09,869   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-12-05T22:04:09,871   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-12-05T22:04:09,872   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-12-05T22:04:09,874   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-12-05T22:04:09,875   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-12-05T22:04:09,876   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-12-05T22:04:09,878   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-12-05T22:04:09,879   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-12-05T22:04:09,880   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-12-05T22:04:09,881   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-12-05T22:04:09,883   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-12-05T22:04:09,884   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-12-05T22:04:09,886   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-12-05T22:04:09,887   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-12-05T22:04:09,888   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-12-05T22:04:09,889   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-12-05T22:04:09,891   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-12-05T22:04:09,892   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-12-05T22:04:09,894   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-12-05T22:04:09,896   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-12-05T22:04:09,897   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-12-05T22:04:09,898   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-12-05T22:04:09,900   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-12-05T22:04:09,901   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-12-05T22:04:09,903   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-12-05T22:04:09,904   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-12-05T22:04:09,906   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-12-05T22:04:09,907   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-12-05T22:04:09,909   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-12-05T22:04:09,910   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-12-05T22:04:09,911   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-12-05T22:04:09,912   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-12-05T22:04:09,914   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-12-05T22:04:09,915   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-12-05T22:04:09,916   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-12-05T22:04:09,918   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-12-05T22:04:09,919   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-12-05T22:04:09,920   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-12-05T22:04:09,922   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-12-05T22:04:09,924   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-12-05T22:04:09,925   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-12-05T22:04:09,927   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-12-05T22:04:09,928   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-12-05T22:04:09,929   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-12-05T22:04:09,931   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-12-05T22:04:09,933   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-12-05T22:04:09,934   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-12-05T22:04:09,935   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-12-05T22:04:09,937   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-12-05T22:04:09,938   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-12-05T22:04:09,940   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-12-05T22:04:09,941   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-12-05T22:04:09,942   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-12-05T22:04:09,943   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-12-05T22:04:09,945   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-12-05T22:04:09,947   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-12-05T22:04:09,949   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-12-05T22:04:09,950   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-12-05T22:04:09,953   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-12-05T22:04:09,955   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-12-05T22:04:09,957   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-12-05T22:04:09,959   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-12-05T22:04:09,960   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-12-05T22:04:09,961   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-12-05T22:04:09,962   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-12-05T22:04:09,964   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-12-05T22:04:09,965   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-12-05T22:04:09,966   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-12-05T22:04:09,967   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-12-05T22:04:09,969   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-12-05T22:04:09,970   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-12-05T22:04:09,972   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-12-05T22:04:09,973   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-12-05T22:04:09,975   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-12-05T22:04:09,976   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-12-05T22:04:09,978   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-12-05T22:04:09,979   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-12-05T22:04:09,981   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-12-05T22:04:09,982   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-12-05T22:04:09,984   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-12-05T22:04:09,985   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-12-05T22:04:09,986   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-12-05T22:04:09,988   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-12-05T22:04:09,989   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-12-05T22:04:09,991   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-12-05T22:04:09,992   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-12-05T22:04:09,994   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-12-05T22:04:09,995   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-12-05T22:04:09,996   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-12-05T22:04:09,997   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-12-05T22:04:09,999   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-12-05T22:04:10,000   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-12-05T22:04:10,002   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-12-05T22:04:10,003   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-12-05T22:04:10,004   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-12-05T22:04:10,006   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-12-05T22:04:10,007   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-12-05T22:04:10,008   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-12-05T22:04:10,010   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-12-05T22:04:10,011   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-12-05T22:04:10,012   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-12-05T22:04:10,014   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-12-05T22:04:10,015   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-12-05T22:04:10,017   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-12-05T22:04:10,018   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-12-05T22:04:10,019   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-12-05T22:04:10,021   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-12-05T22:04:10,022   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-12-05T22:04:10,024   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-12-05T22:04:10,026   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-12-05T22:04:10,027   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-12-05T22:04:10,029   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-12-05T22:04:10,030   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-12-05T22:04:10,031   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-12-05T22:04:10,033   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-12-05T22:04:10,034   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-12-05T22:04:10,036   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-12-05T22:04:10,037   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-12-05T22:04:10,039   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-12-05T22:04:10,040   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-12-05T22:04:10,042   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-12-05T22:04:10,043   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-12-05T22:04:10,045   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-12-05T22:04:10,046   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-12-05T22:04:10,048   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-12-05T22:04:10,049   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-12-05T22:04:10,050   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-12-05T22:04:10,051   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-12-05T22:04:10,053   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-12-05T22:04:10,054   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-12-05T22:04:10,055   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-12-05T22:04:10,057   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-12-05T22:04:10,058   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-12-05T22:04:10,060   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-12-05T22:04:10,061   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-12-05T22:04:10,063   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-12-05T22:04:10,064   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-12-05T22:04:10,066   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-12-05T22:04:10,067   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-12-05T22:04:10,069   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-12-05T22:04:10,071   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-12-05T22:04:10,072   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-12-05T22:04:10,073   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-12-05T22:04:10,075   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-12-05T22:04:10,076   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-12-05T22:04:10,078   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-12-05T22:04:10,079   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-12-05T22:04:10,081   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-12-05T22:04:10,082   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-12-05T22:04:10,084   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-12-05T22:04:10,085   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-12-05T22:04:10,086   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-12-05T22:04:10,088   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-12-05T22:04:10,089   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-12-05T22:04:10,090   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-12-05T22:04:10,092   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-12-05T22:04:10,094   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-12-05T22:04:10,095   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-12-05T22:04:10,097   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-12-05T22:04:10,098   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-12-05T22:04:10,100   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-12-05T22:04:10,102   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-12-05T22:04:10,104   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-12-05T22:04:10,105   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-12-05T22:04:10,107   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-12-05T22:04:10,109   adding 'deepspeed/launcher/__init__.py'
2024-12-05T22:04:10,110   adding 'deepspeed/launcher/constants.py'
2024-12-05T22:04:10,112   adding 'deepspeed/launcher/launch.py'
2024-12-05T22:04:10,114   adding 'deepspeed/launcher/launcher_helper.py'
2024-12-05T22:04:10,117   adding 'deepspeed/launcher/multinode_runner.py'
2024-12-05T22:04:10,120   adding 'deepspeed/launcher/runner.py'
2024-12-05T22:04:10,122   adding 'deepspeed/linear/__init__.py'
2024-12-05T22:04:10,123   adding 'deepspeed/linear/config.py'
2024-12-05T22:04:10,124   adding 'deepspeed/linear/context_manager.py'
2024-12-05T22:04:10,126   adding 'deepspeed/linear/optimized_linear.py'
2024-12-05T22:04:10,127   adding 'deepspeed/linear/quantization.py'
2024-12-05T22:04:10,129   adding 'deepspeed/model_implementations/__init__.py'
2024-12-05T22:04:10,131   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-12-05T22:04:10,132   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-12-05T22:04:10,133   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-12-05T22:04:10,134   adding 'deepspeed/model_implementations/features/__init__.py'
2024-12-05T22:04:10,136   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-12-05T22:04:10,138   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-12-05T22:04:10,139   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-12-05T22:04:10,140   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-12-05T22:04:10,141   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-12-05T22:04:10,142   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-12-05T22:04:10,143   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-12-05T22:04:10,145   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-12-05T22:04:10,146   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-12-05T22:04:10,147   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-12-05T22:04:10,149   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-12-05T22:04:10,151   adding 'deepspeed/module_inject/__init__.py'
2024-12-05T22:04:10,155   adding 'deepspeed/module_inject/auto_tp.py'
2024-12-05T22:04:10,157   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-12-05T22:04:10,159   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-12-05T22:04:10,161   adding 'deepspeed/module_inject/inject.py'
2024-12-05T22:04:10,163   adding 'deepspeed/module_inject/layers.py'
2024-12-05T22:04:10,166   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-12-05T22:04:10,167   adding 'deepspeed/module_inject/module_quantize.py'
2024-12-05T22:04:10,169   adding 'deepspeed/module_inject/policy.py'
2024-12-05T22:04:10,175   adding 'deepspeed/module_inject/replace_module.py'
2024-12-05T22:04:10,176   adding 'deepspeed/module_inject/replace_policy.py'
2024-12-05T22:04:10,178   adding 'deepspeed/module_inject/tp_shard.py'
2024-12-05T22:04:10,179   adding 'deepspeed/module_inject/utils.py'
2024-12-05T22:04:10,182   adding 'deepspeed/module_inject/containers/__init__.py'
2024-12-05T22:04:10,184   adding 'deepspeed/module_inject/containers/base.py'
2024-12-05T22:04:10,187   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-12-05T22:04:10,188   adding 'deepspeed/module_inject/containers/bert.py'
2024-12-05T22:04:10,190   adding 'deepspeed/module_inject/containers/bloom.py'
2024-12-05T22:04:10,192   adding 'deepspeed/module_inject/containers/clip.py'
2024-12-05T22:04:10,193   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-12-05T22:04:10,195   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-12-05T22:04:10,197   adding 'deepspeed/module_inject/containers/gptj.py'
2024-12-05T22:04:10,199   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-12-05T22:04:10,201   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-12-05T22:04:10,203   adding 'deepspeed/module_inject/containers/internlm.py'
2024-12-05T22:04:10,205   adding 'deepspeed/module_inject/containers/llama.py'
2024-12-05T22:04:10,207   adding 'deepspeed/module_inject/containers/llama2.py'
2024-12-05T22:04:10,209   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-12-05T22:04:10,210   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-12-05T22:04:10,213   adding 'deepspeed/module_inject/containers/opt.py'
2024-12-05T22:04:10,214   adding 'deepspeed/module_inject/containers/unet.py'
2024-12-05T22:04:10,215   adding 'deepspeed/module_inject/containers/vae.py'
2024-12-05T22:04:10,217   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-12-05T22:04:10,219   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-12-05T22:04:10,221   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-12-05T22:04:10,223   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-12-05T22:04:10,224   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-12-05T22:04:10,226   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-12-05T22:04:10,228   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-12-05T22:04:10,230   adding 'deepspeed/moe/__init__.py'
2024-12-05T22:04:10,231   adding 'deepspeed/moe/experts.py'
2024-12-05T22:04:10,233   adding 'deepspeed/moe/layer.py'
2024-12-05T22:04:10,235   adding 'deepspeed/moe/mappings.py'
2024-12-05T22:04:10,239   adding 'deepspeed/moe/sharded_moe.py'
2024-12-05T22:04:10,242   adding 'deepspeed/moe/utils.py'
2024-12-05T22:04:10,244   adding 'deepspeed/monitor/__init__.py'
2024-12-05T22:04:10,245   adding 'deepspeed/monitor/comet.py'
2024-12-05T22:04:10,247   adding 'deepspeed/monitor/config.py'
2024-12-05T22:04:10,249   adding 'deepspeed/monitor/csv_monitor.py'
2024-12-05T22:04:10,250   adding 'deepspeed/monitor/monitor.py'
2024-12-05T22:04:10,251   adding 'deepspeed/monitor/tensorboard.py'
2024-12-05T22:04:10,252   adding 'deepspeed/monitor/utils.py'
2024-12-05T22:04:10,253   adding 'deepspeed/monitor/wandb.py'
2024-12-05T22:04:10,255   adding 'deepspeed/nebula/__init__.py'
2024-12-05T22:04:10,256   adding 'deepspeed/nebula/config.py'
2024-12-05T22:04:10,258   adding 'deepspeed/nebula/constants.py'
2024-12-05T22:04:10,259   adding 'deepspeed/nvme/__init__.py'
2024-12-05T22:04:10,261   adding 'deepspeed/nvme/ds_aio_args.py'
2024-12-05T22:04:10,262   adding 'deepspeed/nvme/ds_aio_basic.py'
2024-12-05T22:04:10,264   adding 'deepspeed/nvme/ds_aio_handle.py'
2024-12-05T22:04:10,265   adding 'deepspeed/nvme/ds_aio_job.py'
2024-12-05T22:04:10,267   adding 'deepspeed/nvme/parse_nvme_stats.py'
2024-12-05T22:04:10,268   adding 'deepspeed/nvme/perf_generate_param.py'
2024-12-05T22:04:10,270   adding 'deepspeed/nvme/perf_run_sweep.py'
2024-12-05T22:04:10,271   adding 'deepspeed/nvme/perf_sweep_utils.py'
2024-12-05T22:04:10,272   adding 'deepspeed/nvme/test_ds_aio.py'
2024-12-05T22:04:10,274   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2024-12-05T22:04:10,275   adding 'deepspeed/nvme/validate_async_io.py'
2024-12-05T22:04:10,277   adding 'deepspeed/ops/__init__.py'
2024-12-05T22:04:10,278   adding 'deepspeed/ops/adagrad/__init__.py'
2024-12-05T22:04:10,280   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-12-05T22:04:10,282   adding 'deepspeed/ops/adam/__init__.py'
2024-12-05T22:04:10,283   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-12-05T22:04:10,285   adding 'deepspeed/ops/adam/fused_adam.py'
2024-12-05T22:04:10,286   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-12-05T22:04:10,288   adding 'deepspeed/ops/aio/__init__.py'
2024-12-05T22:04:10,290   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-12-05T22:04:10,292   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-12-05T22:04:10,294   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-12-05T22:04:10,295   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-12-05T22:04:10,297   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-12-05T22:04:10,298   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-12-05T22:04:10,301   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-12-05T22:04:10,302   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-12-05T22:04:10,303   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-12-05T22:04:10,305   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-12-05T22:04:10,306   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-12-05T22:04:10,307   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-12-05T22:04:10,309   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2024-12-05T22:04:10,310   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2024-12-05T22:04:10,311   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-12-05T22:04:10,312   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-12-05T22:04:10,314   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2024-12-05T22:04:10,315   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2024-12-05T22:04:10,316   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-12-05T22:04:10,317   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-12-05T22:04:10,318   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-12-05T22:04:10,320   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-12-05T22:04:10,321   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-12-05T22:04:10,322   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-12-05T22:04:10,323   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-12-05T22:04:10,324   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-12-05T22:04:10,326   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2024-12-05T22:04:10,327   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2024-12-05T22:04:10,329   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-12-05T22:04:10,330   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-12-05T22:04:10,332   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-12-05T22:04:10,335   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-12-05T22:04:10,338   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-12-05T22:04:10,339   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-12-05T22:04:10,340   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-12-05T22:04:10,342   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-12-05T22:04:10,344   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-12-05T22:04:10,346   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-12-05T22:04:10,348   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-12-05T22:04:10,349   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-12-05T22:04:10,357   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-12-05T22:04:10,362   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-12-05T22:04:10,364   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-12-05T22:04:10,367   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-12-05T22:04:10,369   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-12-05T22:04:10,370   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-12-05T22:04:10,372   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-12-05T22:04:10,374   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-12-05T22:04:10,377   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-12-05T22:04:10,380   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-12-05T22:04:10,382   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-12-05T22:04:10,383   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-12-05T22:04:10,391   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-12-05T22:04:10,395   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-12-05T22:04:10,396   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-12-05T22:04:10,400   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-12-05T22:04:10,403   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-12-05T22:04:10,407   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-12-05T22:04:10,409   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-12-05T22:04:10,410   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-12-05T22:04:10,412   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-12-05T22:04:10,414   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-12-05T22:04:10,416   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-12-05T22:04:10,418   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-12-05T22:04:10,420   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-12-05T22:04:10,421   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-12-05T22:04:10,423   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2024-12-05T22:04:10,424   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2024-12-05T22:04:10,426   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2024-12-05T22:04:10,427   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2024-12-05T22:04:10,428   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2024-12-05T22:04:10,430   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2024-12-05T22:04:10,432   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-12-05T22:04:10,433   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-12-05T22:04:10,434   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-12-05T22:04:10,435   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-12-05T22:04:10,437   adding 'deepspeed/ops/csrc/includes/context.h'
2024-12-05T22:04:10,439   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-12-05T22:04:10,440   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-12-05T22:04:10,442   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-12-05T22:04:10,443   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-12-05T22:04:10,444   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-12-05T22:04:10,446   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-12-05T22:04:10,448   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-12-05T22:04:10,449   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-12-05T22:04:10,450   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-12-05T22:04:10,452   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-12-05T22:04:10,453   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-12-05T22:04:10,455   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-12-05T22:04:10,456   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-12-05T22:04:10,457   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-12-05T22:04:10,460   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-12-05T22:04:10,461   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-12-05T22:04:10,463   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-12-05T22:04:10,465   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-12-05T22:04:10,466   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-12-05T22:04:10,469   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-12-05T22:04:10,471   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-12-05T22:04:10,472   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-12-05T22:04:10,474   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-12-05T22:04:10,475   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-12-05T22:04:10,477   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-12-05T22:04:10,478   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-12-05T22:04:10,480   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-12-05T22:04:10,482   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-12-05T22:04:10,483   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-12-05T22:04:10,484   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-12-05T22:04:10,486   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-12-05T22:04:10,487   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-12-05T22:04:10,490   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-12-05T22:04:10,492   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-12-05T22:04:10,494   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-12-05T22:04:10,495   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-12-05T22:04:10,497   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-12-05T22:04:10,498   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-12-05T22:04:10,500   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-12-05T22:04:10,502   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-12-05T22:04:10,503   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-12-05T22:04:10,504   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-12-05T22:04:10,506   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-12-05T22:04:10,509   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-12-05T22:04:10,510   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-12-05T22:04:10,512   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-12-05T22:04:10,514   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-12-05T22:04:10,517   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-12-05T22:04:10,521   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-12-05T22:04:10,523   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-12-05T22:04:10,524   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-12-05T22:04:10,528   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-12-05T22:04:10,531   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-12-05T22:04:10,534   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-12-05T22:04:10,536   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-12-05T22:04:10,538   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-12-05T22:04:10,540   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-12-05T22:04:10,542   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-12-05T22:04:10,544   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-12-05T22:04:10,550   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-12-05T22:04:10,551   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-12-05T22:04:10,553   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-12-05T22:04:10,555   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-12-05T22:04:10,558   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-12-05T22:04:10,561   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-12-05T22:04:10,563   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-12-05T22:04:10,564   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-12-05T22:04:10,566   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-12-05T22:04:10,569   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-12-05T22:04:10,570   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-12-05T22:04:10,572   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-12-05T22:04:10,573   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-12-05T22:04:10,575   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-12-05T22:04:10,577   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-12-05T22:04:10,578   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-12-05T22:04:10,579   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-12-05T22:04:10,581   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-12-05T22:04:10,582   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-12-05T22:04:10,584   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-12-05T22:04:10,586   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-12-05T22:04:10,587   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-12-05T22:04:10,588   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-12-05T22:04:10,590   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-12-05T22:04:10,591   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-12-05T22:04:10,593   adding 'deepspeed/ops/gds/__init__.py'
2024-12-05T22:04:10,595   adding 'deepspeed/ops/lamb/__init__.py'
2024-12-05T22:04:10,596   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-12-05T22:04:10,598   adding 'deepspeed/ops/lion/__init__.py'
2024-12-05T22:04:10,599   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-12-05T22:04:10,601   adding 'deepspeed/ops/lion/fused_lion.py'
2024-12-05T22:04:10,602   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-12-05T22:04:10,604   adding 'deepspeed/ops/op_builder/__init__.py'
2024-12-05T22:04:10,605   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-12-05T22:04:10,607   adding 'deepspeed/ops/op_builder/async_io.py'
2024-12-05T22:04:10,610   adding 'deepspeed/ops/op_builder/builder.py'
2024-12-05T22:04:10,612   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-12-05T22:04:10,613   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-12-05T22:04:10,614   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-12-05T22:04:10,616   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-12-05T22:04:10,617   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-12-05T22:04:10,618   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-12-05T22:04:10,620   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-12-05T22:04:10,621   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-12-05T22:04:10,622   adding 'deepspeed/ops/op_builder/gds.py'
2024-12-05T22:04:10,623   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-12-05T22:04:10,625   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-12-05T22:04:10,626   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-12-05T22:04:10,627   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-12-05T22:04:10,629   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-12-05T22:04:10,630   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-12-05T22:04:10,631   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-12-05T22:04:10,632   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-12-05T22:04:10,634   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-12-05T22:04:10,635   adding 'deepspeed/ops/op_builder/transformer.py'
2024-12-05T22:04:10,636   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-12-05T22:04:10,638   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-12-05T22:04:10,639   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2024-12-05T22:04:10,640   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-12-05T22:04:10,642   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-12-05T22:04:10,643   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-12-05T22:04:10,644   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-12-05T22:04:10,645   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-12-05T22:04:10,647   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-12-05T22:04:10,648   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-12-05T22:04:10,649   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-12-05T22:04:10,650   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-12-05T22:04:10,652   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-12-05T22:04:10,653   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2024-12-05T22:04:10,654   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2024-12-05T22:04:10,656   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2024-12-05T22:04:10,657   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2024-12-05T22:04:10,658   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2024-12-05T22:04:10,659   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2024-12-05T22:04:10,660   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2024-12-05T22:04:10,662   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-12-05T22:04:10,663   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-12-05T22:04:10,665   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-12-05T22:04:10,666   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-12-05T22:04:10,667   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-12-05T22:04:10,668   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-12-05T22:04:10,669   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-12-05T22:04:10,671   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-12-05T22:04:10,672   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-12-05T22:04:10,675   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-12-05T22:04:10,676   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-12-05T22:04:10,677   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-12-05T22:04:10,679   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-12-05T22:04:10,680   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-12-05T22:04:10,681   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-12-05T22:04:10,682   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-12-05T22:04:10,683   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-12-05T22:04:10,685   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-12-05T22:04:10,686   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-12-05T22:04:10,687   adding 'deepspeed/ops/quantizer/__init__.py'
2024-12-05T22:04:10,689   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-12-05T22:04:10,690   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-12-05T22:04:10,692   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-12-05T22:04:10,694   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-12-05T22:04:10,695   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-12-05T22:04:10,699   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-12-05T22:04:10,701   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-12-05T22:04:10,703   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-12-05T22:04:10,704   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-12-05T22:04:10,708   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-12-05T22:04:10,710   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-12-05T22:04:10,711   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-12-05T22:04:10,713   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-12-05T22:04:10,714   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-12-05T22:04:10,716   adding 'deepspeed/ops/transformer/__init__.py'
2024-12-05T22:04:10,718   adding 'deepspeed/ops/transformer/transformer.py'
2024-12-05T22:04:10,720   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-12-05T22:04:10,721   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-12-05T22:04:10,723   adding 'deepspeed/ops/transformer/inference/config.py'
2024-12-05T22:04:10,724   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-12-05T22:04:10,726   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-12-05T22:04:10,727   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-12-05T22:04:10,729   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-12-05T22:04:10,731   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-12-05T22:04:10,733   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-12-05T22:04:10,735   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-12-05T22:04:10,737   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-12-05T22:04:10,738   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-12-05T22:04:10,740   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2024-12-05T22:04:10,741   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2024-12-05T22:04:10,742   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2024-12-05T22:04:10,743   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2024-12-05T22:04:10,744   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2024-12-05T22:04:10,746   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2024-12-05T22:04:10,747   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-12-05T22:04:10,748   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2024-12-05T22:04:10,749   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-12-05T22:04:10,751   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-12-05T22:04:10,752   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2024-12-05T22:04:10,753   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2024-12-05T22:04:10,755   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2024-12-05T22:04:10,756   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-12-05T22:04:10,757   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-12-05T22:04:10,759   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2024-12-05T22:04:10,760   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-12-05T22:04:10,761   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-12-05T22:04:10,763   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2024-12-05T22:04:10,764   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-12-05T22:04:10,766   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2024-12-05T22:04:10,768   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-12-05T22:04:10,770   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-12-05T22:04:10,772   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-12-05T22:04:10,774   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-12-05T22:04:10,776   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-12-05T22:04:10,778   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-12-05T22:04:10,779   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-12-05T22:04:10,780   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-12-05T22:04:10,782   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-12-05T22:04:10,784   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-12-05T22:04:10,785   adding 'deepspeed/pipe/__init__.py'
2024-12-05T22:04:10,787   adding 'deepspeed/profiling/__init__.py'
2024-12-05T22:04:10,788   adding 'deepspeed/profiling/config.py'
2024-12-05T22:04:10,789   adding 'deepspeed/profiling/constants.py'
2024-12-05T22:04:10,791   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-12-05T22:04:10,796   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-12-05T22:04:10,798   adding 'deepspeed/runtime/__init__.py'
2024-12-05T22:04:10,800   adding 'deepspeed/runtime/base_optimizer.py'
2024-12-05T22:04:10,803   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-12-05T22:04:10,804   adding 'deepspeed/runtime/compiler.py'
2024-12-05T22:04:10,809   adding 'deepspeed/runtime/config.py'
2024-12-05T22:04:10,811   adding 'deepspeed/runtime/config_utils.py'
2024-12-05T22:04:10,813   adding 'deepspeed/runtime/constants.py'
2024-12-05T22:04:10,814   adding 'deepspeed/runtime/dataloader.py'
2024-12-05T22:04:10,816   adding 'deepspeed/runtime/eigenvalue.py'
2024-12-05T22:04:10,835   adding 'deepspeed/runtime/engine.py'
2024-12-05T22:04:10,839   adding 'deepspeed/runtime/hybrid_engine.py'
2024-12-05T22:04:10,842   adding 'deepspeed/runtime/lr_schedules.py'
2024-12-05T22:04:10,844   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-12-05T22:04:10,845   adding 'deepspeed/runtime/quantize.py'
2024-12-05T22:04:10,846   adding 'deepspeed/runtime/sparse_tensor.py'
2024-12-05T22:04:10,849   adding 'deepspeed/runtime/state_dict_factory.py'
2024-12-05T22:04:10,853   adding 'deepspeed/runtime/utils.py'
2024-12-05T22:04:10,855   adding 'deepspeed/runtime/weight_quantizer.py'
2024-12-05T22:04:10,857   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-12-05T22:04:10,862   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-12-05T22:04:10,863   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-12-05T22:04:10,865   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-12-05T22:04:10,866   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-12-05T22:04:10,867   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-12-05T22:04:10,869   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-12-05T22:04:10,870   adding 'deepspeed/runtime/comm/__init__.py'
2024-12-05T22:04:10,872   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-12-05T22:04:10,873   adding 'deepspeed/runtime/comm/compressed.py'
2024-12-05T22:04:10,875   adding 'deepspeed/runtime/comm/hccl.py'
2024-12-05T22:04:10,876   adding 'deepspeed/runtime/comm/mpi.py'
2024-12-05T22:04:10,878   adding 'deepspeed/runtime/comm/nccl.py'
2024-12-05T22:04:10,880   adding 'deepspeed/runtime/compression/__init__.py'
2024-12-05T22:04:10,881   adding 'deepspeed/runtime/compression/cupy.py'
2024-12-05T22:04:10,882   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-12-05T22:04:10,884   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-12-05T22:04:10,885   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-12-05T22:04:10,887   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-12-05T22:04:10,888   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-12-05T22:04:10,890   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-12-05T22:04:10,891   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-12-05T22:04:10,892   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-12-05T22:04:10,894   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-12-05T22:04:10,895   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-12-05T22:04:10,900   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-12-05T22:04:10,903   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-12-05T22:04:10,906   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-12-05T22:04:10,907   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-12-05T22:04:10,909   adding 'deepspeed/runtime/domino/__init__.py'
2024-12-05T22:04:10,911   adding 'deepspeed/runtime/domino/transformer.py'
2024-12-05T22:04:10,913   adding 'deepspeed/runtime/fp16/__init__.py'
2024-12-05T22:04:10,916   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-12-05T22:04:10,918   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-12-05T22:04:10,920   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-12-05T22:04:10,922   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-12-05T22:04:10,924   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-12-05T22:04:10,927   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-12-05T22:04:10,929   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-12-05T22:04:10,931   adding 'deepspeed/runtime/pipe/__init__.py'
2024-12-05T22:04:10,938   adding 'deepspeed/runtime/pipe/engine.py'
2024-12-05T22:04:10,941   adding 'deepspeed/runtime/pipe/module.py'
2024-12-05T22:04:10,943   adding 'deepspeed/runtime/pipe/p2p.py'
2024-12-05T22:04:10,945   adding 'deepspeed/runtime/pipe/schedule.py'
2024-12-05T22:04:10,947   adding 'deepspeed/runtime/pipe/topology.py'
2024-12-05T22:04:10,949   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-12-05T22:04:10,950   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-12-05T22:04:10,952   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-12-05T22:04:10,953   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-12-05T22:04:10,956   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-12-05T22:04:10,957   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-12-05T22:04:10,960   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-12-05T22:04:10,961   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-12-05T22:04:10,963   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-12-05T22:04:10,965   adding 'deepspeed/runtime/zero/__init__.py'
2024-12-05T22:04:10,967   adding 'deepspeed/runtime/zero/config.py'
2024-12-05T22:04:10,969   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-12-05T22:04:10,971   adding 'deepspeed/runtime/zero/linear.py'
2024-12-05T22:04:10,974   adding 'deepspeed/runtime/zero/mics.py'
2024-12-05T22:04:10,975   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-12-05T22:04:10,977   adding 'deepspeed/runtime/zero/offload_config.py'
2024-12-05T22:04:10,978   adding 'deepspeed/runtime/zero/offload_states.py'
2024-12-05T22:04:10,981   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-12-05T22:04:10,992   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-12-05T22:04:10,996   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-12-05T22:04:10,998   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-12-05T22:04:11,013   adding 'deepspeed/runtime/zero/stage3.py'
2024-12-05T22:04:11,027   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-12-05T22:04:11,029   adding 'deepspeed/runtime/zero/test.py'
2024-12-05T22:04:11,031   adding 'deepspeed/runtime/zero/tiling.py'
2024-12-05T22:04:11,033   adding 'deepspeed/runtime/zero/utils.py'
2024-12-05T22:04:11,035   adding 'deepspeed/sequence/__init__.py'
2024-12-05T22:04:11,036   adding 'deepspeed/sequence/cross_entropy.py'
2024-12-05T22:04:11,041   adding 'deepspeed/sequence/fpdt_layer.py'
2024-12-05T22:04:11,043   adding 'deepspeed/sequence/layer.py'
2024-12-05T22:04:11,045   adding 'deepspeed/utils/__init__.py'
2024-12-05T22:04:11,047   adding 'deepspeed/utils/bwc.py'
2024-12-05T22:04:11,048   adding 'deepspeed/utils/comms_logging.py'
2024-12-05T22:04:11,049   adding 'deepspeed/utils/config.py'
2024-12-05T22:04:11,051   adding 'deepspeed/utils/debug.py'
2024-12-05T22:04:11,052   adding 'deepspeed/utils/exceptions.py'
2024-12-05T22:04:11,055   adding 'deepspeed/utils/groups.py'
2024-12-05T22:04:11,057   adding 'deepspeed/utils/init_on_device.py'
2024-12-05T22:04:11,058   adding 'deepspeed/utils/logging.py'
2024-12-05T22:04:11,059   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-12-05T22:04:11,061   adding 'deepspeed/utils/numa.py'
2024-12-05T22:04:11,062   adding 'deepspeed/utils/nvtx.py'
2024-12-05T22:04:11,064   adding 'deepspeed/utils/tensor_fragment.py'
2024-12-05T22:04:11,066   adding 'deepspeed/utils/timer.py'
2024-12-05T22:04:11,067   adding 'deepspeed/utils/torch.py'
2024-12-05T22:04:11,068   adding 'deepspeed/utils/types.py'
2024-12-05T22:04:11,070   adding 'deepspeed/utils/z3_leaf_module.py'
2024-12-05T22:04:11,073   adding 'deepspeed/utils/zero_to_fp32.py'
2024-12-05T22:04:11,075   adding 'deepspeed-0.16.1.data/scripts/deepspeed'
2024-12-05T22:04:11,076   adding 'deepspeed-0.16.1.data/scripts/deepspeed.pt'
2024-12-05T22:04:11,077   adding 'deepspeed-0.16.1.data/scripts/ds'
2024-12-05T22:04:11,078   adding 'deepspeed-0.16.1.data/scripts/ds_bench'
2024-12-05T22:04:11,079   adding 'deepspeed-0.16.1.data/scripts/ds_elastic'
2024-12-05T22:04:11,080   adding 'deepspeed-0.16.1.data/scripts/ds_io'
2024-12-05T22:04:11,081   adding 'deepspeed-0.16.1.data/scripts/ds_nvme_tune'
2024-12-05T22:04:11,082   adding 'deepspeed-0.16.1.data/scripts/ds_report'
2024-12-05T22:04:11,083   adding 'deepspeed-0.16.1.data/scripts/ds_ssh'
2024-12-05T22:04:11,084   adding 'deepspeed-0.16.1.data/scripts/dsr'
2024-12-05T22:04:11,087   adding 'deepspeed-0.16.1.dist-info/LICENSE'
2024-12-05T22:04:11,092   adding 'deepspeed-0.16.1.dist-info/METADATA'
2024-12-05T22:04:11,093   adding 'deepspeed-0.16.1.dist-info/WHEEL'
2024-12-05T22:04:11,094   adding 'deepspeed-0.16.1.dist-info/entry_points.txt'
2024-12-05T22:04:11,095   adding 'deepspeed-0.16.1.dist-info/top_level.txt'
2024-12-05T22:04:11,110   adding 'deepspeed-0.16.1.dist-info/RECORD'
2024-12-05T22:04:11,136   removing build/bdist.linux-armv7l/wheel
2024-12-05T22:04:11,353   deepspeed build time = 11.939758539199829 secs
2024-12-05T22:04:11,474   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-12-05T22:04:11,492   Created wheel for deepspeed: filename=deepspeed-0.16.1-py3-none-any.whl size=1543875 sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f
2024-12-05T22:04:11,493   Stored in directory: /tmp/pip-ephem-wheel-cache-li_afagh/wheels/77/be/a6/91e3213c285dd69d9ff6c4e7928010286125f493a9de055a62
2024-12-05T22:04:11,537 Successfully built deepspeed
2024-12-05T22:04:11,593 Removed build tracker: '/tmp/pip-build-tracker-1rf53qi4'