2024-12-18T18:44:05,310 Created temporary directory: /tmp/pip-build-tracker-9eo4bgxn
2024-12-18T18:44:05,311 Initialized build tracking at /tmp/pip-build-tracker-9eo4bgxn
2024-12-18T18:44:05,312 Created build tracker: /tmp/pip-build-tracker-9eo4bgxn
2024-12-18T18:44:05,312 Entered build tracker: /tmp/pip-build-tracker-9eo4bgxn
2024-12-18T18:44:05,313 Created temporary directory: /tmp/pip-wheel-64a5k7_y
2024-12-18T18:44:05,317 Created temporary directory: /tmp/pip-ephem-wheel-cache-eucz1x0z
2024-12-18T18:44:05,361 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-12-18T18:44:05,364 2 location(s) to search for versions of deepspeed:
2024-12-18T18:44:05,364 * https://pypi.org/simple/deepspeed/
2024-12-18T18:44:05,364 * https://www.piwheels.org/simple/deepspeed/
2024-12-18T18:44:05,365 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-12-18T18:44:05,366 Getting page https://pypi.org/simple/deepspeed/
2024-12-18T18:44:05,367 Found index url https://pypi.org/simple/
2024-12-18T18:44:05,514 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-12-18T18:44:05,533   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-18T18:44:05,534   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-12-18T18:44:05,535   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-18T18:44:05,535   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-12-18T18:44:05,536   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-18T18:44:05,537   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-12-18T18:44:05,538   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-18T18:44:05,538   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-12-18T18:44:05,539   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-12-18T18:44:05,540   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-12-18T18:44:05,541   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-12-18T18:44:05,541   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-12-18T18:44:05,542   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-12-18T18:44:05,543   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-12-18T18:44:05,544   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-12-18T18:44:05,544   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-12-18T18:44:05,545   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-12-18T18:44:05,546   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-12-18T18:44:05,546   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-12-18T18:44:05,547   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-12-18T18:44:05,547   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-12-18T18:44:05,548   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-12-18T18:44:05,549   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-12-18T18:44:05,549   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-12-18T18:44:05,550   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-12-18T18:44:05,551   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-12-18T18:44:05,552   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-12-18T18:44:05,553   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-12-18T18:44:05,553   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-12-18T18:44:05,554   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-12-18T18:44:05,555   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-12-18T18:44:05,556   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-12-18T18:44:05,556   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-12-18T18:44:05,557   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-12-18T18:44:05,557   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-12-18T18:44:05,558   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-12-18T18:44:05,558   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-12-18T18:44:05,559   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-12-18T18:44:05,560   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-12-18T18:44:05,560   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-12-18T18:44:05,561   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-12-18T18:44:05,562   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-12-18T18:44:05,562   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-12-18T18:44:05,563   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-12-18T18:44:05,564   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-12-18T18:44:05,565   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-12-18T18:44:05,565   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-12-18T18:44:05,566   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-12-18T18:44:05,567   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-12-18T18:44:05,568   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-12-18T18:44:05,569   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-12-18T18:44:05,569   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-12-18T18:44:05,570   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-12-18T18:44:05,570   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-12-18T18:44:05,571   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-12-18T18:44:05,571   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-12-18T18:44:05,572   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-12-18T18:44:05,573   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-12-18T18:44:05,573   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-12-18T18:44:05,574   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-12-18T18:44:05,575   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-12-18T18:44:05,576   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-12-18T18:44:05,577   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-12-18T18:44:05,577   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-12-18T18:44:05,578   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-12-18T18:44:05,579   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-12-18T18:44:05,579   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-12-18T18:44:05,580   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-12-18T18:44:05,581   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-12-18T18:44:05,581   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-12-18T18:44:05,582   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-12-18T18:44:05,582   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-12-18T18:44:05,583   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-12-18T18:44:05,584   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-12-18T18:44:05,584   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-12-18T18:44:05,585   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-12-18T18:44:05,585   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-12-18T18:44:05,586   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-12-18T18:44:05,587   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-12-18T18:44:05,588   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-12-18T18:44:05,589   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-12-18T18:44:05,589   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-12-18T18:44:05,590   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-12-18T18:44:05,591   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-12-18T18:44:05,591   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-12-18T18:44:05,592   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-12-18T18:44:05,593   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-12-18T18:44:05,593   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-12-18T18:44:05,594   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-12-18T18:44:05,595   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-12-18T18:44:05,595   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-12-18T18:44:05,596   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-12-18T18:44:05,596   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-12-18T18:44:05,597   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-12-18T18:44:05,598   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-12-18T18:44:05,598   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-12-18T18:44:05,599   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-12-18T18:44:05,600   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-12-18T18:44:05,600   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-12-18T18:44:05,601   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2024-12-18T18:44:05,602   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2024-12-18T18:44:05,602   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2024-12-18T18:44:05,603   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2024-12-18T18:44:05,604   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2024-12-18T18:44:05,605   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2024-12-18T18:44:05,605   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2024-12-18T18:44:05,606   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2024-12-18T18:44:05,606 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-12-18T18:44:05,607 Getting page https://www.piwheels.org/simple/deepspeed/
2024-12-18T18:44:05,608 Found index url https://www.piwheels.org/simple/
2024-12-18T18:44:05,774 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-12-18T18:44:05,793   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,794   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,794   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,795   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,796   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,796   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,797   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,798   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,798   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,799   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,799   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,800   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,801   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,801   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,802   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,802   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,803   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,803   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,804   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,804   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,805   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,806   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,806   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,807   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,807   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,808   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,809   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,810   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,810   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,810   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,811   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,811   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,812   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,812   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,813   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,814   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,814   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,815   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,816   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,816   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,817   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,818   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,818   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,819   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,819   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,820   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,821   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,821   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,822   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,823   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,823   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,824   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,825   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,825   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,826   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,826   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,827   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,828   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,828   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,828   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,829   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,829   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,830   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,831   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,831   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,832   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,832   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,833   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,834   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,834   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,835   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,835   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,836   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,836   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-12-18T18:44:05,837 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-12-18T18:44:05,837 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-12-18T18:44:05,869 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-12-18T18:44:05,871 Collecting deepspeed==0.16.2
2024-12-18T18:44:05,874   Created temporary directory: /tmp/pip-unpack-untbbuz6
2024-12-18T18:44:06,018   Downloading deepspeed-0.16.2.tar.gz (1.4 MB)
2024-12-18T18:44:08,525   Added deepspeed==0.16.2 from https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz to build tracker '/tmp/pip-build-tracker-9eo4bgxn'
2024-12-18T18:44:08,527   Running setup.py (path:/tmp/pip-wheel-64a5k7_y/deepspeed_064e082d78164b9d9c550428dad34e17/setup.py) egg_info for package deepspeed
2024-12-18T18:44:08,528   Created temporary directory: /tmp/pip-pip-egg-info-syzppiwt
2024-12-18T18:44:08,529   Preparing metadata (setup.py): started
2024-12-18T18:44:08,530   Running command python setup.py egg_info
2024-12-18T18:44:09,500   fatal: not a git repository (or any of the parent directories): .git
2024-12-18T18:44:10,184   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-12-18T18:44:10,185    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-12-18T18:44:10,186   DS_BUILD_OPS=0
2024-12-18T18:44:10,186   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2024-12-18T18:44:10,187   version=0.16.2, git_hash=unknown, git_branch=unknown
2024-12-18T18:44:10,187   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-12-18T18:44:10,188   ext_modules=[]
2024-12-18T18:44:10,189   running egg_info
2024-12-18T18:44:10,213   creating /tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info
2024-12-18T18:44:10,214   writing /tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info/PKG-INFO
2024-12-18T18:44:10,247   writing dependency_links to /tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info/dependency_links.txt
2024-12-18T18:44:10,249   writing entry points to /tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info/entry_points.txt
2024-12-18T18:44:10,267   writing requirements to /tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info/requires.txt
2024-12-18T18:44:10,268   writing top-level names to /tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info/top_level.txt
2024-12-18T18:44:10,269   writing manifest file '/tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info/SOURCES.txt'
2024-12-18T18:44:10,513   reading manifest file '/tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info/SOURCES.txt'
2024-12-18T18:44:10,515   reading manifest template 'MANIFEST.in'
2024-12-18T18:44:10,516   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-12-18T18:44:10,517   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-12-18T18:44:12,166   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-12-18T18:44:13,135   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-12-18T18:44:13,815   warning: no files found matching '*.tr' under directory 'csrc'
2024-12-18T18:44:13,938   warning: no files found matching '*.cc' under directory 'csrc'
2024-12-18T18:44:13,982   warning: no files found matching '*.py' under directory 'benchmarks'
2024-12-18T18:44:13,988   adding license file 'LICENSE'
2024-12-18T18:44:14,026   writing manifest file '/tmp/pip-pip-egg-info-syzppiwt/deepspeed.egg-info/SOURCES.txt'
2024-12-18T18:44:14,029   deepspeed build time = 4.526461839675903 secs
2024-12-18T18:44:14,148   Preparing metadata (setup.py): finished with status 'done'
2024-12-18T18:44:14,154   Source in /tmp/pip-wheel-64a5k7_y/deepspeed_064e082d78164b9d9c550428dad34e17 has version 0.16.2, which satisfies requirement deepspeed==0.16.2 from https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz
2024-12-18T18:44:14,155   Removed deepspeed==0.16.2 from https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz from build tracker '/tmp/pip-build-tracker-9eo4bgxn'
2024-12-18T18:44:14,227 Created temporary directory: /tmp/pip-unpack-0b7d4u1v
2024-12-18T18:44:14,229 Created temporary directory: /tmp/pip-unpack-5i5fqrpf
2024-12-18T18:44:14,229 Building wheels for collected packages: deepspeed
2024-12-18T18:44:14,234   Created temporary directory: /tmp/pip-wheel-t_583i1m
2024-12-18T18:44:14,234   Building wheel for deepspeed (setup.py): started
2024-12-18T18:44:14,235   Destination directory: /tmp/pip-wheel-t_583i1m
2024-12-18T18:44:14,236   Running command python setup.py bdist_wheel
2024-12-18T18:44:14,766   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-12-18T18:44:14,771    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-12-18T18:44:14,893   DS_BUILD_OPS=0
2024-12-18T18:44:15,008   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2024-12-18T18:44:15,027   fatal: not a git repository (or any of the parent directories): .git
2024-12-18T18:44:15,028   version=0.16.2, git_hash=unknown, git_branch=unknown
2024-12-18T18:44:15,029   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-12-18T18:44:15,030   ext_modules=[]
2024-12-18T18:44:15,649   running bdist_wheel
2024-12-18T18:44:15,793   running build
2024-12-18T18:44:15,794   running build_py
2024-12-18T18:44:15,829   creating build/lib/deepspeed
2024-12-18T18:44:15,831   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-12-18T18:44:15,833   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-12-18T18:44:15,835   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-12-18T18:44:15,838   copying deepspeed/constants.py -> build/lib/deepspeed
2024-12-18T18:44:15,840   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-12-18T18:44:15,843   creating build/lib/deepspeed/pipe
2024-12-18T18:44:15,844   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-12-18T18:44:15,847   creating build/lib/deepspeed/comm
2024-12-18T18:44:15,848   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,851   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,853   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,855   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,857   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,859   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,860   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,863   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,865   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-12-18T18:44:15,867   creating build/lib/deepspeed/profiling
2024-12-18T18:44:15,869   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-12-18T18:44:15,871   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-12-18T18:44:15,872   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-12-18T18:44:15,875   creating build/lib/deepspeed/inference
2024-12-18T18:44:15,876   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-12-18T18:44:15,878   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-12-18T18:44:15,880   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-12-18T18:44:15,884   creating build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,885   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,888   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,891   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,893   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,895   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,898   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,899   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,901   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,904   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,906   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-12-18T18:44:15,909   creating build/lib/deepspeed/ops
2024-12-18T18:44:15,910   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-12-18T18:44:15,913   creating build/lib/deepspeed/accelerator
2024-12-18T18:44:15,914   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,916   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,919   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,921   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,924   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,926   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,928   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,931   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,934   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,936   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-12-18T18:44:15,939   creating build/lib/deepspeed/compression
2024-12-18T18:44:15,940   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-12-18T18:44:15,943   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-12-18T18:44:15,945   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-12-18T18:44:15,947   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-12-18T18:44:15,949   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-12-18T18:44:15,952   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-12-18T18:44:15,955   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-12-18T18:44:15,957   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-12-18T18:44:15,960   creating build/lib/deepspeed/sequence
2024-12-18T18:44:15,961   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2024-12-18T18:44:15,965   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-12-18T18:44:15,968   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-12-18T18:44:15,970   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2024-12-18T18:44:15,973   creating build/lib/deepspeed/utils
2024-12-18T18:44:15,974   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,976   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,978   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,980   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,983   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,985   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,987   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,990   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,992   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,994   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,997   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-12-18T18:44:15,999   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-12-18T18:44:16,001   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-12-18T18:44:16,003   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-12-18T18:44:16,005   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-12-18T18:44:16,008   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-12-18T18:44:16,009   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-12-18T18:44:16,011   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-12-18T18:44:16,014   creating build/lib/deepspeed/module_inject
2024-12-18T18:44:16,015   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,018   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,020   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,022   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,025   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,027   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,029   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,032   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,034   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,036   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,039   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,042   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,043   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-12-18T18:44:16,046   creating build/lib/deepspeed/moe
2024-12-18T18:44:16,047   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-12-18T18:44:16,050   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-12-18T18:44:16,052   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-12-18T18:44:16,054   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-12-18T18:44:16,057   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-12-18T18:44:16,059   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-12-18T18:44:16,061   creating build/lib/deepspeed/autotuning
2024-12-18T18:44:16,062   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-12-18T18:44:16,065   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-12-18T18:44:16,068   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-12-18T18:44:16,070   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-12-18T18:44:16,072   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-12-18T18:44:16,074   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-12-18T18:44:16,078   creating build/lib/deepspeed/elasticity
2024-12-18T18:44:16,079   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-12-18T18:44:16,082   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-12-18T18:44:16,084   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-12-18T18:44:16,086   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-12-18T18:44:16,088   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-12-18T18:44:16,091   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-12-18T18:44:16,093   creating build/lib/deepspeed/linear
2024-12-18T18:44:16,094   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-12-18T18:44:16,097   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-12-18T18:44:16,099   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-12-18T18:44:16,101   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-12-18T18:44:16,104   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-12-18T18:44:16,107   creating build/lib/deepspeed/launcher
2024-12-18T18:44:16,108   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-12-18T18:44:16,111   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-12-18T18:44:16,113   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-12-18T18:44:16,116   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-12-18T18:44:16,118   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-12-18T18:44:16,120   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-12-18T18:44:16,122   creating build/lib/deepspeed/nebula
2024-12-18T18:44:16,123   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-12-18T18:44:16,126   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-12-18T18:44:16,127   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-12-18T18:44:16,130   creating build/lib/deepspeed/model_implementations
2024-12-18T18:44:16,131   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-12-18T18:44:16,133   creating build/lib/deepspeed/monitor
2024-12-18T18:44:16,135   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-12-18T18:44:16,137   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-12-18T18:44:16,138   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-12-18T18:44:16,140   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-12-18T18:44:16,142   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-12-18T18:44:16,144   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-12-18T18:44:16,146   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-12-18T18:44:16,148   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-12-18T18:44:16,151   creating build/lib/deepspeed/runtime
2024-12-18T18:44:16,152   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,154   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,156   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,159   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,161   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,163   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,165   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,168   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,170   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,172   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,174   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,177   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,179   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,185   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,188   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,190   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,193   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,196   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-12-18T18:44:16,200   creating build/lib/deepspeed/nvme
2024-12-18T18:44:16,201   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,203   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,205   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,207   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,209   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,211   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,213   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,215   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,217   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,219   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,220   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,223   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2024-12-18T18:44:16,226   creating build/lib/deepspeed/profiling/flops_profiler
2024-12-18T18:44:16,227   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-12-18T18:44:16,230   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-12-18T18:44:16,232   creating build/lib/deepspeed/inference/quantization
2024-12-18T18:44:16,234   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-12-18T18:44:16,236   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-12-18T18:44:16,238   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-12-18T18:44:16,240   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-12-18T18:44:16,242   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-12-18T18:44:16,245   creating build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,246   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,248   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,250   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,252   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,254   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,255   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,257   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,259   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,262   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-12-18T18:44:16,265   creating build/lib/deepspeed/inference/v2/modules
2024-12-18T18:44:16,266   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-12-18T18:44:16,268   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-12-18T18:44:16,270   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-12-18T18:44:16,272   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-12-18T18:44:16,275   creating build/lib/deepspeed/inference/v2/checkpoint
2024-12-18T18:44:16,276   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-12-18T18:44:16,278   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-12-18T18:44:16,280   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-12-18T18:44:16,282   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-12-18T18:44:16,284   creating build/lib/deepspeed/inference/v2/kernels
2024-12-18T18:44:16,286   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-12-18T18:44:16,288   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-12-18T18:44:16,290   creating build/lib/deepspeed/inference/v2/ragged
2024-12-18T18:44:16,291   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-18T18:44:16,294   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-18T18:44:16,297   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-18T18:44:16,299   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-18T18:44:16,301   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-18T18:44:16,303   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-18T18:44:16,305   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-12-18T18:44:16,309   creating build/lib/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:16,310   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:16,312   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:16,315   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:16,317   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:16,319   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:16,321   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:16,324   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:16,327   creating build/lib/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:16,329   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:16,331   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:16,332   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:16,335   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:16,337   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:16,339   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:16,341   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:16,343   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-12-18T18:44:16,344   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-12-18T18:44:16,347   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,348   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,351   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,353   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,355   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,357   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,359   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,361   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,363   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:16,366   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-12-18T18:44:16,367   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-12-18T18:44:16,369   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-12-18T18:44:16,372   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-12-18T18:44:16,373   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-12-18T18:44:16,375   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-12-18T18:44:16,378   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-12-18T18:44:16,379   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-12-18T18:44:16,381   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-12-18T18:44:16,383   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-12-18T18:44:16,385   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-12-18T18:44:16,387   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-12-18T18:44:16,390   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-12-18T18:44:16,391   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-12-18T18:44:16,394   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-12-18T18:44:16,396   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-18T18:44:16,397   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-18T18:44:16,399   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-18T18:44:16,401   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-18T18:44:16,404   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-12-18T18:44:16,405   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-12-18T18:44:16,408   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-12-18T18:44:16,410   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-12-18T18:44:16,412   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-12-18T18:44:16,413   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-12-18T18:44:16,416   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-12-18T18:44:16,417   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-12-18T18:44:16,419   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-12-18T18:44:16,421   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-12-18T18:44:16,423   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:16,424   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:16,426   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:16,429   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:16,430   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:16,432   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:16,435   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:16,436   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:16,438   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:16,440   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:16,442   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:16,444   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:16,446   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:16,447   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:16,450   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:16,452   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:16,454   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:16,456   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:16,458   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:16,460   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:16,462   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:16,464   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:16,466   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:16,468   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:16,470   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:16,472   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:16,474   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:16,476   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:16,478   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:16,480   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:16,482   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:16,484   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:16,485   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:16,487   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:16,490   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:16,491   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:16,493   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:16,496   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:16,497   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:16,499   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:16,501   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:16,503   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:16,505   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:16,508   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:16,509   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:16,511   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:16,514   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:16,515   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:16,517   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:16,519   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:16,521   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:16,523   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:16,526   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:16,527   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:16,529   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:16,531   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:16,534   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:16,535   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:16,537   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:16,539   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:16,541   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:16,544   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:16,545   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:16,547   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:16,549   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:16,552   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:16,554   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:16,555   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:16,558   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:16,560   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:16,562   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:16,565   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:16,566   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:16,568   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:16,570   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:16,573   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:16,575   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:16,577   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:16,579   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:16,581   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:16,584   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:16,587   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,589   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,591   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,593   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,595   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,597   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,599   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,601   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,603   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,605   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:16,607   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:16,609   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:16,611   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:16,613   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:16,615   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:16,618   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:16,619   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:16,622   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:16,624   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:16,626   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:16,628   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,630   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,632   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,634   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,636   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,638   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,641   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,643   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,645   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,647   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:16,650   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:16,651   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:16,653   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:16,655   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:16,657   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:16,660   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:16,661   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:16,663   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:16,665   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:16,667   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:16,670   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:16,671   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:16,673   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:16,676   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:16,679   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:16,682   creating build/lib/deepspeed/ops/random_ltd
2024-12-18T18:44:16,683   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-12-18T18:44:16,686   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-12-18T18:44:16,688   creating build/lib/deepspeed/ops/lion
2024-12-18T18:44:16,690   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-12-18T18:44:16,692   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-12-18T18:44:16,694   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-12-18T18:44:16,696   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-12-18T18:44:16,699   creating build/lib/deepspeed/ops/fp_quantizer
2024-12-18T18:44:16,700   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-12-18T18:44:16,702   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-12-18T18:44:16,705   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-12-18T18:44:16,707   creating build/lib/deepspeed/ops/adagrad
2024-12-18T18:44:16,709   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-12-18T18:44:16,711   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-12-18T18:44:16,714   creating build/lib/deepspeed/ops/transformer
2024-12-18T18:44:16,715   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-12-18T18:44:16,717   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-12-18T18:44:16,720   creating build/lib/deepspeed/ops/lamb
2024-12-18T18:44:16,721   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-12-18T18:44:16,722   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-12-18T18:44:16,725   creating build/lib/deepspeed/ops/aio
2024-12-18T18:44:16,726   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-12-18T18:44:16,729   creating build/lib/deepspeed/ops/deepspeed4science
2024-12-18T18:44:16,730   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-12-18T18:44:16,732   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-12-18T18:44:16,735   creating build/lib/deepspeed/ops/sparse_attention
2024-12-18T18:44:16,736   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-18T18:44:16,739   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-18T18:44:16,741   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-18T18:44:16,742   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-18T18:44:16,745   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-18T18:44:16,748   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-18T18:44:16,751   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-12-18T18:44:16,755   creating build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,756   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,758   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,760   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,763   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,765   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,767   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,769   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,771   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,773   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,775   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,777   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,780   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,782   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,785   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,787   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,789   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,791   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,794   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,796   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,798   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,799   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,802   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,804   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,806   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-12-18T18:44:16,808   creating build/lib/deepspeed/ops/gds
2024-12-18T18:44:16,809   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2024-12-18T18:44:16,812   creating build/lib/deepspeed/ops/adam
2024-12-18T18:44:16,813   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-12-18T18:44:16,815   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-12-18T18:44:16,818   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-12-18T18:44:16,819   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-12-18T18:44:16,822   creating build/lib/deepspeed/ops/quantizer
2024-12-18T18:44:16,823   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-12-18T18:44:16,825   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-12-18T18:44:16,828   creating build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,829   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,832   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,834   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,837   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,840   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,842   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,844   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,847   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,850   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,853   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-12-18T18:44:16,856   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,857   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,860   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,863   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,865   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,868   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,870   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,873   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,876   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,878   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,881   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:16,885   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,886   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,888   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,890   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,892   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,894   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,896   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,898   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,900   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,903   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,905   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,907   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,909   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,912   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,915   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,917   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,919   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,922   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,925   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,927   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,930   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,932   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,934   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,936   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:16,939   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:16,940   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:16,943   creating build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,944   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,946   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,949   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,950   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,953   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,954   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,956   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,959   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,961   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-12-18T18:44:16,964   creating build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,966   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,969   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,971   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,973   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,976   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,978   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,980   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,982   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,984   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,986   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:16,989   creating build/lib/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:16,990   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:16,992   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:16,994   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:16,996   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:16,998   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:17,000   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:17,002   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:17,004   creating build/lib/deepspeed/ops/op_builder/hpu
2024-12-18T18:44:17,006   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-18T18:44:17,008   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-18T18:44:17,010   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-18T18:44:17,013   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-18T18:44:17,014   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-18T18:44:17,016   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-12-18T18:44:17,019   creating build/lib/deepspeed/ops/op_builder/mlu
2024-12-18T18:44:17,020   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-18T18:44:17,022   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-18T18:44:17,024   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-18T18:44:17,026   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-18T18:44:17,028   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-18T18:44:17,030   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-12-18T18:44:17,033   creating build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,034   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,036   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,038   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,040   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,043   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,045   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,047   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,050   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,052   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,054   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,056   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,058   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,061   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,063   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,066   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,068   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,071   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,073   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,075   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-12-18T18:44:17,078   creating build/lib/deepspeed/module_inject/containers/features
2024-12-18T18:44:17,080   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-18T18:44:17,083   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-18T18:44:17,085   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-18T18:44:17,087   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-18T18:44:17,090   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-18T18:44:17,091   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-18T18:44:17,094   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-12-18T18:44:17,096   creating build/lib/deepspeed/autotuning/tuner
2024-12-18T18:44:17,097   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-12-18T18:44:17,100   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-12-18T18:44:17,102   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-12-18T18:44:17,103   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-12-18T18:44:17,105   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-12-18T18:44:17,107   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-12-18T18:44:17,110   creating build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,111   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,114   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,116   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,118   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,120   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,121   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,123   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,126   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,127   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,129   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-12-18T18:44:17,132   creating build/lib/deepspeed/model_implementations/diffusers
2024-12-18T18:44:17,133   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-12-18T18:44:17,136   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-12-18T18:44:17,138   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-12-18T18:44:17,140   creating build/lib/deepspeed/model_implementations/features
2024-12-18T18:44:17,142   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-12-18T18:44:17,144   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-12-18T18:44:17,147   creating build/lib/deepspeed/runtime/pipe
2024-12-18T18:44:17,148   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-12-18T18:44:17,151   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-12-18T18:44:17,154   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-12-18T18:44:17,155   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-12-18T18:44:17,158   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-12-18T18:44:17,161   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-12-18T18:44:17,164   creating build/lib/deepspeed/runtime/comm
2024-12-18T18:44:17,166   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-12-18T18:44:17,168   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-12-18T18:44:17,170   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-12-18T18:44:17,173   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-12-18T18:44:17,175   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-12-18T18:44:17,177   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-12-18T18:44:17,180   creating build/lib/deepspeed/runtime/data_pipeline
2024-12-18T18:44:17,181   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-12-18T18:44:17,184   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-12-18T18:44:17,186   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-12-18T18:44:17,189   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-12-18T18:44:17,193   creating build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,194   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,197   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,200   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,205   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,210   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,213   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,216   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,218   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,221   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,224   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,227   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,230   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,233   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,238   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,240   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,243   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,246   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-12-18T18:44:17,252   creating build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,253   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,256   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,259   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,262   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,265   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,267   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,270   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,272   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,275   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-12-18T18:44:17,278   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:17,280   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:17,282   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:17,285   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:17,287   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:17,290   creating build/lib/deepspeed/runtime/compression
2024-12-18T18:44:17,291   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-12-18T18:44:17,294   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-12-18T18:44:17,296   creating build/lib/deepspeed/runtime/fp16
2024-12-18T18:44:17,298   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-12-18T18:44:17,301   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-12-18T18:44:17,303   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-12-18T18:44:17,306   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-12-18T18:44:17,310   creating build/lib/deepspeed/runtime/domino
2024-12-18T18:44:17,311   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2024-12-18T18:44:17,314   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2024-12-18T18:44:17,319   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-12-18T18:44:17,322   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-12-18T18:44:17,329   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-12-18T18:44:17,337   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-12-18T18:44:17,344   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:17,347   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:17,349   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:17,352   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:17,354   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:17,357   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:17,360   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:17,362   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:17,366   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:17,369   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:17,372   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:17,375   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:17,378   creating build/lib/deepspeed/runtime/fp16/onebit
2024-12-18T18:44:17,379   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-12-18T18:44:17,383   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-12-18T18:44:17,385   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-12-18T18:44:17,388   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-12-18T18:44:17,391   running egg_info
2024-12-18T18:44:17,421   writing deepspeed.egg-info/PKG-INFO
2024-12-18T18:44:17,455   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-12-18T18:44:17,457   writing entry points to deepspeed.egg-info/entry_points.txt
2024-12-18T18:44:17,475   writing requirements to deepspeed.egg-info/requires.txt
2024-12-18T18:44:17,476   writing top-level names to deepspeed.egg-info/top_level.txt
2024-12-18T18:44:17,611   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-12-18T18:44:17,689   reading manifest template 'MANIFEST.in'
2024-12-18T18:44:17,691   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-12-18T18:44:17,692   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-12-18T18:44:19,256   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-12-18T18:44:20,200   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-12-18T18:44:20,830   warning: no files found matching '*.tr' under directory 'csrc'
2024-12-18T18:44:20,947   warning: no files found matching '*.cc' under directory 'csrc'
2024-12-18T18:44:20,989   warning: no files found matching '*.py' under directory 'benchmarks'
2024-12-18T18:44:20,994   adding license file 'LICENSE'
2024-12-18T18:44:21,045   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-12-18T18:44:21,054   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-12-18T18:44:21,054   !!

2024-12-18T18:44:21,056           ********************************************************************************
2024-12-18T18:44:21,056           ############################
2024-12-18T18:44:21,057           # Package would be ignored #
2024-12-18T18:44:21,057           ############################
2024-12-18T18:44:21,058           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-12-18T18:44:21,059           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,060           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,060           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-12-18T18:44:21,061           to the `packages` configuration field.

2024-12-18T18:44:21,062           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,063           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,063           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,065           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,066           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,067           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-12-18T18:44:21,068           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-12-18T18:44:21,068           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,068           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,069           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,070           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,070           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,071           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,072                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,072                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,073                 directory, all directories are treated like packages.
2024-12-18T18:44:21,073           ********************************************************************************

2024-12-18T18:44:21,074   !!
2024-12-18T18:44:21,074     check.warn(importable)
2024-12-18T18:44:21,075   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-12-18T18:44:21,075   !!

2024-12-18T18:44:21,077           ********************************************************************************
2024-12-18T18:44:21,077           ############################
2024-12-18T18:44:21,078           # Package would be ignored #
2024-12-18T18:44:21,078           ############################
2024-12-18T18:44:21,079           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-12-18T18:44:21,079           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,080           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,081           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-12-18T18:44:21,082           to the `packages` configuration field.

2024-12-18T18:44:21,083           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,083           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,084           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,085           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,086           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,087           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-12-18T18:44:21,087           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-12-18T18:44:21,088           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,088           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,089           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,090           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,091           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,093           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,094                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,094                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,095                 directory, all directories are treated like packages.
2024-12-18T18:44:21,095           ********************************************************************************

2024-12-18T18:44:21,096   !!
2024-12-18T18:44:21,096     check.warn(importable)
2024-12-18T18:44:21,096   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-12-18T18:44:21,097   !!

2024-12-18T18:44:21,097           ********************************************************************************
2024-12-18T18:44:21,098           ############################
2024-12-18T18:44:21,098           # Package would be ignored #
2024-12-18T18:44:21,099           ############################
2024-12-18T18:44:21,099           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-12-18T18:44:21,099           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,100           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,101           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-12-18T18:44:21,101           to the `packages` configuration field.

2024-12-18T18:44:21,102           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,102           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,103           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,104           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,105           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,106           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-12-18T18:44:21,106           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-12-18T18:44:21,107           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,107           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,108           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,109           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,110           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,111           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,112                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,112                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,113                 directory, all directories are treated like packages.
2024-12-18T18:44:21,113           ********************************************************************************

2024-12-18T18:44:21,114   !!
2024-12-18T18:44:21,115     check.warn(importable)
2024-12-18T18:44:21,115   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-12-18T18:44:21,116   !!

2024-12-18T18:44:21,117           ********************************************************************************
2024-12-18T18:44:21,117           ############################
2024-12-18T18:44:21,118           # Package would be ignored #
2024-12-18T18:44:21,119           ############################
2024-12-18T18:44:21,119           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-12-18T18:44:21,121           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,121           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,122           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-12-18T18:44:21,122           to the `packages` configuration field.

2024-12-18T18:44:21,123           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,123           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,123           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,124           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,125           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,125           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-12-18T18:44:21,126           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-12-18T18:44:21,126           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,127           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,127           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,128           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,129           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,131           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,131                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,132                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,133                 directory, all directories are treated like packages.
2024-12-18T18:44:21,133           ********************************************************************************

2024-12-18T18:44:21,134   !!
2024-12-18T18:44:21,135     check.warn(importable)
2024-12-18T18:44:21,136   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-12-18T18:44:21,136   !!

2024-12-18T18:44:21,138           ********************************************************************************
2024-12-18T18:44:21,138           ############################
2024-12-18T18:44:21,139           # Package would be ignored #
2024-12-18T18:44:21,140           ############################
2024-12-18T18:44:21,140           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-12-18T18:44:21,141           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,142           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,143           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-12-18T18:44:21,143           to the `packages` configuration field.

2024-12-18T18:44:21,145           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,145           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,146           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,147           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,149           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,150           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-12-18T18:44:21,151           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-12-18T18:44:21,152           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,153           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,153           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,154           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,155           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,157           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,158                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,158                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,158                 directory, all directories are treated like packages.
2024-12-18T18:44:21,159           ********************************************************************************

2024-12-18T18:44:21,160   !!
2024-12-18T18:44:21,160     check.warn(importable)
2024-12-18T18:44:21,161   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-12-18T18:44:21,161   !!

2024-12-18T18:44:21,163           ********************************************************************************
2024-12-18T18:44:21,163           ############################
2024-12-18T18:44:21,164           # Package would be ignored #
2024-12-18T18:44:21,165           ############################
2024-12-18T18:44:21,165           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-12-18T18:44:21,166           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,167           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,167           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-12-18T18:44:21,168           to the `packages` configuration field.

2024-12-18T18:44:21,169           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,170           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,171           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,172           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,173           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,174           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-12-18T18:44:21,175           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-12-18T18:44:21,175           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,176           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,177           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,178           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,179           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,181           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,182                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,183                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,183                 directory, all directories are treated like packages.
2024-12-18T18:44:21,184           ********************************************************************************

2024-12-18T18:44:21,185   !!
2024-12-18T18:44:21,186     check.warn(importable)
2024-12-18T18:44:21,186   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-12-18T18:44:21,187   !!

2024-12-18T18:44:21,187           ********************************************************************************
2024-12-18T18:44:21,188           ############################
2024-12-18T18:44:21,188           # Package would be ignored #
2024-12-18T18:44:21,189           ############################
2024-12-18T18:44:21,189           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-12-18T18:44:21,190           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,191           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,191           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-12-18T18:44:21,191           to the `packages` configuration field.

2024-12-18T18:44:21,192           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,193           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,193           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,194           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,195           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,197           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-12-18T18:44:21,197           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-12-18T18:44:21,198           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,199           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,199           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,200           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,202           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,204           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,204                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,205                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,206                 directory, all directories are treated like packages.
2024-12-18T18:44:21,206           ********************************************************************************

2024-12-18T18:44:21,208   !!
2024-12-18T18:44:21,208     check.warn(importable)
2024-12-18T18:44:21,209   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-12-18T18:44:21,210   !!

2024-12-18T18:44:21,211           ********************************************************************************
2024-12-18T18:44:21,211           ############################
2024-12-18T18:44:21,212           # Package would be ignored #
2024-12-18T18:44:21,212           ############################
2024-12-18T18:44:21,213           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-12-18T18:44:21,214           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,215           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,216           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-12-18T18:44:21,216           to the `packages` configuration field.

2024-12-18T18:44:21,218           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,218           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,219           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,220           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,220           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,221           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-12-18T18:44:21,222           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-12-18T18:44:21,222           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,223           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,223           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,224           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,225           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,227           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,227                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,228                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,229                 directory, all directories are treated like packages.
2024-12-18T18:44:21,229           ********************************************************************************

2024-12-18T18:44:21,230   !!
2024-12-18T18:44:21,231     check.warn(importable)
2024-12-18T18:44:21,232   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-12-18T18:44:21,232   !!

2024-12-18T18:44:21,233           ********************************************************************************
2024-12-18T18:44:21,233           ############################
2024-12-18T18:44:21,234           # Package would be ignored #
2024-12-18T18:44:21,235           ############################
2024-12-18T18:44:21,235           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-12-18T18:44:21,236           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,237           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,237           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-12-18T18:44:21,238           to the `packages` configuration field.

2024-12-18T18:44:21,239           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,239           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,240           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,241           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,242           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,243           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-12-18T18:44:21,244           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-12-18T18:44:21,244           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,245           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,246           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,247           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,248           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,249           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,250                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,250                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,250                 directory, all directories are treated like packages.
2024-12-18T18:44:21,251           ********************************************************************************

2024-12-18T18:44:21,251   !!
2024-12-18T18:44:21,252     check.warn(importable)
2024-12-18T18:44:21,252   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-12-18T18:44:21,252   !!

2024-12-18T18:44:21,253           ********************************************************************************
2024-12-18T18:44:21,253           ############################
2024-12-18T18:44:21,254           # Package would be ignored #
2024-12-18T18:44:21,254           ############################
2024-12-18T18:44:21,254           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-12-18T18:44:21,255           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,255           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,256           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-12-18T18:44:21,256           to the `packages` configuration field.

2024-12-18T18:44:21,257           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,258           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,258           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,259           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,260           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,261           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-12-18T18:44:21,262           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-12-18T18:44:21,262           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,263           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,263           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,264           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,265           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,267           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,267                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,267                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,268                 directory, all directories are treated like packages.
2024-12-18T18:44:21,269           ********************************************************************************

2024-12-18T18:44:21,269   !!
2024-12-18T18:44:21,270     check.warn(importable)
2024-12-18T18:44:21,270   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-12-18T18:44:21,271   !!

2024-12-18T18:44:21,272           ********************************************************************************
2024-12-18T18:44:21,273           ############################
2024-12-18T18:44:21,273           # Package would be ignored #
2024-12-18T18:44:21,274           ############################
2024-12-18T18:44:21,274           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-12-18T18:44:21,275           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,277           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,277           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-12-18T18:44:21,277           to the `packages` configuration field.

2024-12-18T18:44:21,278           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,278           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,278           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,279           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,280           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,281           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-12-18T18:44:21,281           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-12-18T18:44:21,281           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,282           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,282           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,283           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,283           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,285           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,285                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,286                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,286                 directory, all directories are treated like packages.
2024-12-18T18:44:21,287           ********************************************************************************

2024-12-18T18:44:21,288   !!
2024-12-18T18:44:21,288     check.warn(importable)
2024-12-18T18:44:21,289   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-12-18T18:44:21,289   !!

2024-12-18T18:44:21,291           ********************************************************************************
2024-12-18T18:44:21,291           ############################
2024-12-18T18:44:21,292           # Package would be ignored #
2024-12-18T18:44:21,292           ############################
2024-12-18T18:44:21,293           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-12-18T18:44:21,293           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,294           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,295           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-12-18T18:44:21,295           to the `packages` configuration field.

2024-12-18T18:44:21,296           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,296           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,297           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,298           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,299           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,300           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-12-18T18:44:21,300           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-12-18T18:44:21,301           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,302           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,302           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,303           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,303           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,304           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,305                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,305                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,305                 directory, all directories are treated like packages.
2024-12-18T18:44:21,306           ********************************************************************************

2024-12-18T18:44:21,306   !!
2024-12-18T18:44:21,307     check.warn(importable)
2024-12-18T18:44:21,307   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-12-18T18:44:21,307   !!

2024-12-18T18:44:21,308           ********************************************************************************
2024-12-18T18:44:21,309           ############################
2024-12-18T18:44:21,309           # Package would be ignored #
2024-12-18T18:44:21,309           ############################
2024-12-18T18:44:21,310           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-12-18T18:44:21,310           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,311           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,312           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-12-18T18:44:21,313           to the `packages` configuration field.

2024-12-18T18:44:21,313           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,314           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,315           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,316           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,317           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,318           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-12-18T18:44:21,319           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-12-18T18:44:21,319           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,320           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,320           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,321           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,322           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,324           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,324                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,325                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,325                 directory, all directories are treated like packages.
2024-12-18T18:44:21,326           ********************************************************************************

2024-12-18T18:44:21,327   !!
2024-12-18T18:44:21,327     check.warn(importable)
2024-12-18T18:44:21,328   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-12-18T18:44:21,328   !!

2024-12-18T18:44:21,330           ********************************************************************************
2024-12-18T18:44:21,330           ############################
2024-12-18T18:44:21,330           # Package would be ignored #
2024-12-18T18:44:21,331           ############################
2024-12-18T18:44:21,331           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-12-18T18:44:21,331           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,332           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,333           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-12-18T18:44:21,333           to the `packages` configuration field.

2024-12-18T18:44:21,334           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,334           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,334           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,335           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,336           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,337           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-12-18T18:44:21,337           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-12-18T18:44:21,337           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,338           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,338           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,339           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,340           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,342           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,343                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,343                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,344                 directory, all directories are treated like packages.
2024-12-18T18:44:21,344           ********************************************************************************

2024-12-18T18:44:21,345   !!
2024-12-18T18:44:21,346     check.warn(importable)
2024-12-18T18:44:21,347   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-12-18T18:44:21,347   !!

2024-12-18T18:44:21,348           ********************************************************************************
2024-12-18T18:44:21,348           ############################
2024-12-18T18:44:21,349           # Package would be ignored #
2024-12-18T18:44:21,349           ############################
2024-12-18T18:44:21,350           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-12-18T18:44:21,350           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,351           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,352           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-12-18T18:44:21,352           to the `packages` configuration field.

2024-12-18T18:44:21,354           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,354           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,355           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,356           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,357           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,357           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-12-18T18:44:21,358           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-12-18T18:44:21,358           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,358           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,359           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,359           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,360           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,361           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,361                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,362                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,362                 directory, all directories are treated like packages.
2024-12-18T18:44:21,362           ********************************************************************************

2024-12-18T18:44:21,363   !!
2024-12-18T18:44:21,363     check.warn(importable)
2024-12-18T18:44:21,364   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-12-18T18:44:21,364   !!

2024-12-18T18:44:21,365           ********************************************************************************
2024-12-18T18:44:21,366           ############################
2024-12-18T18:44:21,366           # Package would be ignored #
2024-12-18T18:44:21,367           ############################
2024-12-18T18:44:21,367           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-12-18T18:44:21,368           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,369           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,370           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-12-18T18:44:21,370           to the `packages` configuration field.

2024-12-18T18:44:21,371           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,372           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,372           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,373           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,374           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,375           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-12-18T18:44:21,375           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-12-18T18:44:21,376           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,376           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,377           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,378           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,379           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,380           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,381                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,381                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,382                 directory, all directories are treated like packages.
2024-12-18T18:44:21,383           ********************************************************************************

2024-12-18T18:44:21,383   !!
2024-12-18T18:44:21,384     check.warn(importable)
2024-12-18T18:44:21,384   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-12-18T18:44:21,384   !!

2024-12-18T18:44:21,385           ********************************************************************************
2024-12-18T18:44:21,385           ############################
2024-12-18T18:44:21,386           # Package would be ignored #
2024-12-18T18:44:21,386           ############################
2024-12-18T18:44:21,386           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-12-18T18:44:21,387           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,387           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,388           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-12-18T18:44:21,388           to the `packages` configuration field.

2024-12-18T18:44:21,389           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,390           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,390           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,391           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,392           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,393           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-12-18T18:44:21,394           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-12-18T18:44:21,394           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,395           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,395           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,396           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,397           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,399           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,399                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,400                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,400                 directory, all directories are treated like packages.
2024-12-18T18:44:21,401           ********************************************************************************

2024-12-18T18:44:21,402   !!
2024-12-18T18:44:21,402     check.warn(importable)
2024-12-18T18:44:21,403   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-12-18T18:44:21,403   !!

2024-12-18T18:44:21,404           ********************************************************************************
2024-12-18T18:44:21,404           ############################
2024-12-18T18:44:21,405           # Package would be ignored #
2024-12-18T18:44:21,405           ############################
2024-12-18T18:44:21,406           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-12-18T18:44:21,406           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,408           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,408           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-12-18T18:44:21,408           to the `packages` configuration field.

2024-12-18T18:44:21,409           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,409           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,410           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,410           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,411           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,412           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-12-18T18:44:21,412           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-12-18T18:44:21,413           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,413           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,413           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,414           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,415           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,416           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,417                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,417                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,418                 directory, all directories are treated like packages.
2024-12-18T18:44:21,418           ********************************************************************************

2024-12-18T18:44:21,419   !!
2024-12-18T18:44:21,420     check.warn(importable)
2024-12-18T18:44:21,421   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-12-18T18:44:21,422   !!

2024-12-18T18:44:21,423           ********************************************************************************
2024-12-18T18:44:21,423           ############################
2024-12-18T18:44:21,424           # Package would be ignored #
2024-12-18T18:44:21,424           ############################
2024-12-18T18:44:21,425           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-12-18T18:44:21,425           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,426           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,427           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-12-18T18:44:21,427           to the `packages` configuration field.

2024-12-18T18:44:21,428           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,429           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,429           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,430           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,431           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,433           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-12-18T18:44:21,433           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-12-18T18:44:21,434           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,435           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,435           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,436           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,436           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,437           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,438                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,438                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,438                 directory, all directories are treated like packages.
2024-12-18T18:44:21,439           ********************************************************************************

2024-12-18T18:44:21,439   !!
2024-12-18T18:44:21,440     check.warn(importable)
2024-12-18T18:44:21,440   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-12-18T18:44:21,441   !!

2024-12-18T18:44:21,441           ********************************************************************************
2024-12-18T18:44:21,442           ############################
2024-12-18T18:44:21,442           # Package would be ignored #
2024-12-18T18:44:21,443           ############################
2024-12-18T18:44:21,443           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-12-18T18:44:21,444           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,445           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,445           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-12-18T18:44:21,446           to the `packages` configuration field.

2024-12-18T18:44:21,447           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,448           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,448           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,450           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,451           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,451           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-12-18T18:44:21,452           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-12-18T18:44:21,452           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,453           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,453           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,454           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,455           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,457           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,457                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,458                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,458                 directory, all directories are treated like packages.
2024-12-18T18:44:21,459           ********************************************************************************

2024-12-18T18:44:21,461   !!
2024-12-18T18:44:21,461     check.warn(importable)
2024-12-18T18:44:21,461   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-12-18T18:44:21,462   !!

2024-12-18T18:44:21,462           ********************************************************************************
2024-12-18T18:44:21,463           ############################
2024-12-18T18:44:21,463           # Package would be ignored #
2024-12-18T18:44:21,463           ############################
2024-12-18T18:44:21,464           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-12-18T18:44:21,464           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,465           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,465           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-12-18T18:44:21,466           to the `packages` configuration field.

2024-12-18T18:44:21,466           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,467           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,467           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,468           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,469           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,469           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-12-18T18:44:21,470           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-12-18T18:44:21,471           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,471           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,472           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,473           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,474           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,475           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,476                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,477                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,477                 directory, all directories are treated like packages.
2024-12-18T18:44:21,477           ********************************************************************************

2024-12-18T18:44:21,478   !!
2024-12-18T18:44:21,479     check.warn(importable)
2024-12-18T18:44:21,479   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-12-18T18:44:21,480   !!

2024-12-18T18:44:21,481           ********************************************************************************
2024-12-18T18:44:21,481           ############################
2024-12-18T18:44:21,482           # Package would be ignored #
2024-12-18T18:44:21,482           ############################
2024-12-18T18:44:21,483           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-12-18T18:44:21,483           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,484           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,485           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-12-18T18:44:21,485           to the `packages` configuration field.

2024-12-18T18:44:21,487           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,487           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,487           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,488           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,489           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,489           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-12-18T18:44:21,490           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-12-18T18:44:21,490           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,490           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,491           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,491           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,492           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,493           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,494                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,494                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,495                 directory, all directories are treated like packages.
2024-12-18T18:44:21,495           ********************************************************************************

2024-12-18T18:44:21,496   !!
2024-12-18T18:44:21,497     check.warn(importable)
2024-12-18T18:44:21,497   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-12-18T18:44:21,498   !!

2024-12-18T18:44:21,499           ********************************************************************************
2024-12-18T18:44:21,499           ############################
2024-12-18T18:44:21,500           # Package would be ignored #
2024-12-18T18:44:21,501           ############################
2024-12-18T18:44:21,501           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-12-18T18:44:21,502           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,503           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,503           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-12-18T18:44:21,504           to the `packages` configuration field.

2024-12-18T18:44:21,505           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,505           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,506           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,507           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,508           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,509           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-12-18T18:44:21,509           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-12-18T18:44:21,510           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,510           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,511           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,512           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,513           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,514           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,514                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,515                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,515                 directory, all directories are treated like packages.
2024-12-18T18:44:21,515           ********************************************************************************

2024-12-18T18:44:21,516   !!
2024-12-18T18:44:21,517     check.warn(importable)
2024-12-18T18:44:21,517   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2024-12-18T18:44:21,517   !!

2024-12-18T18:44:21,518           ********************************************************************************
2024-12-18T18:44:21,518           ############################
2024-12-18T18:44:21,519           # Package would be ignored #
2024-12-18T18:44:21,519           ############################
2024-12-18T18:44:21,519           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2024-12-18T18:44:21,520           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,521           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,521           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2024-12-18T18:44:21,521           to the `packages` configuration field.

2024-12-18T18:44:21,523           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,523           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,524           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,525           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,526           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,527           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2024-12-18T18:44:21,527           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2024-12-18T18:44:21,528           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,528           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,529           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,530           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,531           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,533           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,533                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,534                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,534                 directory, all directories are treated like packages.
2024-12-18T18:44:21,534           ********************************************************************************

2024-12-18T18:44:21,536   !!
2024-12-18T18:44:21,536     check.warn(importable)
2024-12-18T18:44:21,537   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-12-18T18:44:21,537   !!

2024-12-18T18:44:21,539           ********************************************************************************
2024-12-18T18:44:21,539           ############################
2024-12-18T18:44:21,540           # Package would be ignored #
2024-12-18T18:44:21,541           ############################
2024-12-18T18:44:21,541           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-12-18T18:44:21,541           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,542           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,543           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-12-18T18:44:21,543           to the `packages` configuration field.

2024-12-18T18:44:21,544           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,544           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,545           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,545           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,546           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,547           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-12-18T18:44:21,548           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-12-18T18:44:21,548           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,548           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,549           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,550           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,551           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,552           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,553                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,553                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,554                 directory, all directories are treated like packages.
2024-12-18T18:44:21,554           ********************************************************************************

2024-12-18T18:44:21,555   !!
2024-12-18T18:44:21,556     check.warn(importable)
2024-12-18T18:44:21,556   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-12-18T18:44:21,557   !!

2024-12-18T18:44:21,558           ********************************************************************************
2024-12-18T18:44:21,558           ############################
2024-12-18T18:44:21,559           # Package would be ignored #
2024-12-18T18:44:21,560           ############################
2024-12-18T18:44:21,560           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-12-18T18:44:21,561           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,562           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,562           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-12-18T18:44:21,563           to the `packages` configuration field.

2024-12-18T18:44:21,564           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,564           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,565           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,566           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,567           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,568           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-12-18T18:44:21,569           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-12-18T18:44:21,570           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,570           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,571           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,571           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,572           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,574           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,574                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,574                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,575                 directory, all directories are treated like packages.
2024-12-18T18:44:21,575           ********************************************************************************

2024-12-18T18:44:21,576   !!
2024-12-18T18:44:21,577     check.warn(importable)
2024-12-18T18:44:21,577   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-12-18T18:44:21,578   !!

2024-12-18T18:44:21,578           ********************************************************************************
2024-12-18T18:44:21,579           ############################
2024-12-18T18:44:21,579           # Package would be ignored #
2024-12-18T18:44:21,580           ############################
2024-12-18T18:44:21,580           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-12-18T18:44:21,581           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,582           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,583           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-12-18T18:44:21,583           to the `packages` configuration field.

2024-12-18T18:44:21,584           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,585           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,585           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,586           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,587           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,588           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-12-18T18:44:21,589           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-12-18T18:44:21,590           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,590           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,591           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,592           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,593           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,595           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,595                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,596                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,596                 directory, all directories are treated like packages.
2024-12-18T18:44:21,597           ********************************************************************************

2024-12-18T18:44:21,598   !!
2024-12-18T18:44:21,599     check.warn(importable)
2024-12-18T18:44:21,600   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-12-18T18:44:21,601   !!

2024-12-18T18:44:21,601           ********************************************************************************
2024-12-18T18:44:21,602           ############################
2024-12-18T18:44:21,602           # Package would be ignored #
2024-12-18T18:44:21,603           ############################
2024-12-18T18:44:21,603           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-12-18T18:44:21,604           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,605           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,605           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-12-18T18:44:21,606           to the `packages` configuration field.

2024-12-18T18:44:21,607           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,608           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,608           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,610           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,611           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,612           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-12-18T18:44:21,613           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-12-18T18:44:21,613           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,614           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,615           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,616           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,617           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,618           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,619                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,619                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,620                 directory, all directories are treated like packages.
2024-12-18T18:44:21,620           ********************************************************************************

2024-12-18T18:44:21,622   !!
2024-12-18T18:44:21,622     check.warn(importable)
2024-12-18T18:44:21,623   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-12-18T18:44:21,623   !!

2024-12-18T18:44:21,624           ********************************************************************************
2024-12-18T18:44:21,625           ############################
2024-12-18T18:44:21,626           # Package would be ignored #
2024-12-18T18:44:21,626           ############################
2024-12-18T18:44:21,627           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-12-18T18:44:21,627           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,629           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,629           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-12-18T18:44:21,630           to the `packages` configuration field.

2024-12-18T18:44:21,631           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,631           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,632           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,633           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,634           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,635           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-12-18T18:44:21,635           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-12-18T18:44:21,636           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,636           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,637           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,638           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,639           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,640           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,640                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,641                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,641                 directory, all directories are treated like packages.
2024-12-18T18:44:21,642           ********************************************************************************

2024-12-18T18:44:21,643   !!
2024-12-18T18:44:21,643     check.warn(importable)
2024-12-18T18:44:21,644   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-12-18T18:44:21,645   !!

2024-12-18T18:44:21,646           ********************************************************************************
2024-12-18T18:44:21,646           ############################
2024-12-18T18:44:21,647           # Package would be ignored #
2024-12-18T18:44:21,647           ############################
2024-12-18T18:44:21,648           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-12-18T18:44:21,649           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,650           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,650           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-12-18T18:44:21,651           to the `packages` configuration field.

2024-12-18T18:44:21,652           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,652           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,653           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,654           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,655           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,657           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-12-18T18:44:21,658           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-12-18T18:44:21,658           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,658           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,659           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,660           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,661           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,663           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,664                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,665                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,665                 directory, all directories are treated like packages.
2024-12-18T18:44:21,666           ********************************************************************************

2024-12-18T18:44:21,667   !!
2024-12-18T18:44:21,667     check.warn(importable)
2024-12-18T18:44:21,667   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-12-18T18:44:21,668   !!

2024-12-18T18:44:21,669           ********************************************************************************
2024-12-18T18:44:21,669           ############################
2024-12-18T18:44:21,670           # Package would be ignored #
2024-12-18T18:44:21,670           ############################
2024-12-18T18:44:21,671           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-12-18T18:44:21,671           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,672           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,673           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-12-18T18:44:21,673           to the `packages` configuration field.

2024-12-18T18:44:21,674           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,674           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,675           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,676           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,677           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,678           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-12-18T18:44:21,679           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-12-18T18:44:21,679           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,680           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,680           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,681           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,682           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,684           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,685                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,685                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,686                 directory, all directories are treated like packages.
2024-12-18T18:44:21,686           ********************************************************************************

2024-12-18T18:44:21,687   !!
2024-12-18T18:44:21,688     check.warn(importable)
2024-12-18T18:44:21,689   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-12-18T18:44:21,689   !!

2024-12-18T18:44:21,690           ********************************************************************************
2024-12-18T18:44:21,691           ############################
2024-12-18T18:44:21,691           # Package would be ignored #
2024-12-18T18:44:21,692           ############################
2024-12-18T18:44:21,692           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-12-18T18:44:21,693           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,694           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,695           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-12-18T18:44:21,695           to the `packages` configuration field.

2024-12-18T18:44:21,696           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,696           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,697           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,698           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,699           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,700           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-12-18T18:44:21,700           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-12-18T18:44:21,701           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,701           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,702           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,703           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,704           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,705           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,706                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,706                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,707                 directory, all directories are treated like packages.
2024-12-18T18:44:21,707           ********************************************************************************

2024-12-18T18:44:21,708   !!
2024-12-18T18:44:21,709     check.warn(importable)
2024-12-18T18:44:21,709   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-12-18T18:44:21,710   !!

2024-12-18T18:44:21,711           ********************************************************************************
2024-12-18T18:44:21,711           ############################
2024-12-18T18:44:21,712           # Package would be ignored #
2024-12-18T18:44:21,713           ############################
2024-12-18T18:44:21,713           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-12-18T18:44:21,714           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,715           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,715           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-12-18T18:44:21,716           to the `packages` configuration field.

2024-12-18T18:44:21,717           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,717           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,718           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,719           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,720           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,721           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-12-18T18:44:21,722           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-12-18T18:44:21,723           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,723           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,724           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,725           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,726           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,727           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,728                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,728                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,729                 directory, all directories are treated like packages.
2024-12-18T18:44:21,729           ********************************************************************************

2024-12-18T18:44:21,730   !!
2024-12-18T18:44:21,731     check.warn(importable)
2024-12-18T18:44:21,731   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-12-18T18:44:21,732   !!

2024-12-18T18:44:21,732           ********************************************************************************
2024-12-18T18:44:21,733           ############################
2024-12-18T18:44:21,733           # Package would be ignored #
2024-12-18T18:44:21,734           ############################
2024-12-18T18:44:21,734           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-12-18T18:44:21,734           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,736           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,736           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-12-18T18:44:21,736           to the `packages` configuration field.

2024-12-18T18:44:21,737           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,738           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,739           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,740           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,741           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,742           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-12-18T18:44:21,742           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-12-18T18:44:21,743           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,743           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,744           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,745           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,746           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,747           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,748                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,749                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,749                 directory, all directories are treated like packages.
2024-12-18T18:44:21,750           ********************************************************************************

2024-12-18T18:44:21,750   !!
2024-12-18T18:44:21,751     check.warn(importable)
2024-12-18T18:44:21,751   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-12-18T18:44:21,752   !!

2024-12-18T18:44:21,753           ********************************************************************************
2024-12-18T18:44:21,753           ############################
2024-12-18T18:44:21,754           # Package would be ignored #
2024-12-18T18:44:21,754           ############################
2024-12-18T18:44:21,755           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-12-18T18:44:21,755           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,756           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,757           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-12-18T18:44:21,757           to the `packages` configuration field.

2024-12-18T18:44:21,758           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,758           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,759           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,761           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,762           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,763           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-12-18T18:44:21,763           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-12-18T18:44:21,764           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,765           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,765           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,766           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,767           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,769           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,769                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,770                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,770                 directory, all directories are treated like packages.
2024-12-18T18:44:21,771           ********************************************************************************

2024-12-18T18:44:21,772   !!
2024-12-18T18:44:21,773     check.warn(importable)
2024-12-18T18:44:21,773   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-12-18T18:44:21,774   !!

2024-12-18T18:44:21,775           ********************************************************************************
2024-12-18T18:44:21,775           ############################
2024-12-18T18:44:21,776           # Package would be ignored #
2024-12-18T18:44:21,777           ############################
2024-12-18T18:44:21,778           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-12-18T18:44:21,779           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,823           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,824           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-12-18T18:44:21,824           to the `packages` configuration field.

2024-12-18T18:44:21,826           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,826           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,827           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,829           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,830           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,831           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-12-18T18:44:21,831           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-12-18T18:44:21,832           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,832           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,832           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,833           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,834           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,836           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,836                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,837                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,837                 directory, all directories are treated like packages.
2024-12-18T18:44:21,838           ********************************************************************************

2024-12-18T18:44:21,839   !!
2024-12-18T18:44:21,839     check.warn(importable)
2024-12-18T18:44:21,840   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-12-18T18:44:21,841   !!

2024-12-18T18:44:21,842           ********************************************************************************
2024-12-18T18:44:21,843           ############################
2024-12-18T18:44:21,844           # Package would be ignored #
2024-12-18T18:44:21,845           ############################
2024-12-18T18:44:21,846           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-12-18T18:44:21,847           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,849           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,850           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-12-18T18:44:21,851           to the `packages` configuration field.

2024-12-18T18:44:21,854           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,855           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,856           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,859           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,860           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,861           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-12-18T18:44:21,862           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-12-18T18:44:21,862           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,863           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,863           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,864           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,865           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,868           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,868                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,869                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,870                 directory, all directories are treated like packages.
2024-12-18T18:44:21,870           ********************************************************************************

2024-12-18T18:44:21,871   !!
2024-12-18T18:44:21,871     check.warn(importable)
2024-12-18T18:44:21,872   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-12-18T18:44:21,873   !!

2024-12-18T18:44:21,874           ********************************************************************************
2024-12-18T18:44:21,874           ############################
2024-12-18T18:44:21,875           # Package would be ignored #
2024-12-18T18:44:21,875           ############################
2024-12-18T18:44:21,876           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-12-18T18:44:21,876           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,877           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,877           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-12-18T18:44:21,878           to the `packages` configuration field.

2024-12-18T18:44:21,879           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,880           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,880           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,882           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,883           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,884           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-12-18T18:44:21,884           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-12-18T18:44:21,885           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,885           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,886           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,886           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,888           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,889           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,890                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,890                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,891                 directory, all directories are treated like packages.
2024-12-18T18:44:21,892           ********************************************************************************

2024-12-18T18:44:21,893   !!
2024-12-18T18:44:21,894     check.warn(importable)
2024-12-18T18:44:21,894   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-12-18T18:44:21,895   !!

2024-12-18T18:44:21,896           ********************************************************************************
2024-12-18T18:44:21,896           ############################
2024-12-18T18:44:21,897           # Package would be ignored #
2024-12-18T18:44:21,897           ############################
2024-12-18T18:44:21,898           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-12-18T18:44:21,899           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,900           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,900           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-12-18T18:44:21,901           to the `packages` configuration field.

2024-12-18T18:44:21,902           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,902           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,903           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,903           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,904           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,905           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-12-18T18:44:21,906           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-12-18T18:44:21,906           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,907           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,907           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,908           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,909           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,911           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,911                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,912                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,912                 directory, all directories are treated like packages.
2024-12-18T18:44:21,912           ********************************************************************************

2024-12-18T18:44:21,914   !!
2024-12-18T18:44:21,914     check.warn(importable)
2024-12-18T18:44:21,915   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-12-18T18:44:21,915   !!

2024-12-18T18:44:21,916           ********************************************************************************
2024-12-18T18:44:21,917           ############################
2024-12-18T18:44:21,917           # Package would be ignored #
2024-12-18T18:44:21,917           ############################
2024-12-18T18:44:21,918           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-12-18T18:44:21,918           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,920           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,920           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-12-18T18:44:21,921           to the `packages` configuration field.

2024-12-18T18:44:21,922           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,923           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,923           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,924           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,926           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,927           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-12-18T18:44:21,927           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-12-18T18:44:21,928           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,928           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,929           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,930           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,931           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,932           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,932                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,933                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,933                 directory, all directories are treated like packages.
2024-12-18T18:44:21,934           ********************************************************************************

2024-12-18T18:44:21,935   !!
2024-12-18T18:44:21,935     check.warn(importable)
2024-12-18T18:44:21,936   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-12-18T18:44:21,936   !!

2024-12-18T18:44:21,938           ********************************************************************************
2024-12-18T18:44:21,938           ############################
2024-12-18T18:44:21,939           # Package would be ignored #
2024-12-18T18:44:21,940           ############################
2024-12-18T18:44:21,940           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-12-18T18:44:21,941           but it is absent from setuptools' `packages` configuration.

2024-12-18T18:44:21,942           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-18T18:44:21,943           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-12-18T18:44:21,944           to the `packages` configuration field.

2024-12-18T18:44:21,945           Alternatively, you can also rely on setuptools' discovery methods
2024-12-18T18:44:21,946           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-18T18:44:21,947           instead of `find_packages(...)`/`find:`).

2024-12-18T18:44:21,948           You can read more about "package discovery" on setuptools documentation page:

2024-12-18T18:44:21,950           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-18T18:44:21,951           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-12-18T18:44:21,952           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-12-18T18:44:21,953           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-18T18:44:21,953           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-18T18:44:21,954           combination with a more fine grained `package-data` configuration.

2024-12-18T18:44:21,955           You can read more about "package data files" on setuptools documentation page:

2024-12-18T18:44:21,957           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-18T18:44:21,959           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-18T18:44:21,960                 even if it does not contain any `.py` files.
2024-12-18T18:44:21,960                 On the other hand, currently there is no concept of package data
2024-12-18T18:44:21,961                 directory, all directories are treated like packages.
2024-12-18T18:44:21,962           ********************************************************************************

2024-12-18T18:44:21,963   !!
2024-12-18T18:44:21,965     check.warn(importable)
2024-12-18T18:44:21,965   creating build/lib/deepspeed/ops/csrc/adagrad
2024-12-18T18:44:21,966   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-12-18T18:44:21,967   creating build/lib/deepspeed/ops/csrc/adam
2024-12-18T18:44:21,968   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-12-18T18:44:21,969   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-12-18T18:44:21,970   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-12-18T18:44:21,970   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-12-18T18:44:21,971   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-12-18T18:44:21,971   creating build/lib/deepspeed/ops/csrc/aio/common
2024-12-18T18:44:21,972   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-18T18:44:21,973   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-18T18:44:21,973   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-18T18:44:21,974   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-18T18:44:21,974   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-18T18:44:21,975   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-12-18T18:44:21,976   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,976   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,977   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,978   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,978   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,979   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,979   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,980   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,981   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,981   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,982   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,983   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,983   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,984   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,985   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,986   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,986   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,987   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:21,988   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-12-18T18:44:21,989   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-12-18T18:44:21,989   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-12-18T18:44:21,990   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-12-18T18:44:21,991   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:21,992   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:21,993   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:21,993   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:21,994   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:21,995   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-12-18T18:44:21,995   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-12-18T18:44:21,996   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:21,996   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:21,997   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:21,998   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:21,998   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:21,999   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:21,999   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:22,000   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:22,001   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:22,001   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:22,002   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:22,002   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:22,003   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:22,004   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:22,004   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:22,005   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:22,006   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:22,007   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:22,008   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:22,008   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:22,009   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:22,010   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:22,011   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:22,011   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:22,012   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:22,013   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:22,013   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:22,014   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:22,015   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-18T18:44:22,016   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-18T18:44:22,016   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-18T18:44:22,017   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-12-18T18:44:22,018   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-12-18T18:44:22,018   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-12-18T18:44:22,019   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-12-18T18:44:22,020   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-12-18T18:44:22,021   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-12-18T18:44:22,021   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:22,022   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:22,023   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:22,024   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:22,024   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:22,025   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:22,026   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:22,027   creating build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,027   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,028   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,029   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,029   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,030   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,031   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,032   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,033   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,033   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,034   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,034   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,035   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,036   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,036   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,037   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,037   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,038   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,039   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,039   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,040   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,040   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,041   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,044   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,047   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,049   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,052   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,055   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,057   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,060   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-12-18T18:44:22,062   creating build/lib/deepspeed/ops/csrc/lamb
2024-12-18T18:44:22,064   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-12-18T18:44:22,066   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-12-18T18:44:22,069   creating build/lib/deepspeed/ops/csrc/lion
2024-12-18T18:44:22,070   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-12-18T18:44:22,072   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-12-18T18:44:22,075   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-12-18T18:44:22,077   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-12-18T18:44:22,080   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-12-18T18:44:22,082   creating build/lib/deepspeed/ops/csrc/quantization
2024-12-18T18:44:22,083   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-18T18:44:22,086   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-18T18:44:22,089   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-12-18T18:44:22,092   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-18T18:44:22,095   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-18T18:44:22,098   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-18T18:44:22,100   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-12-18T18:44:22,103   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:22,105   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:22,108   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:22,111   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:22,114   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:22,117   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-12-18T18:44:22,118   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-12-18T18:44:22,120   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-12-18T18:44:22,122   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-12-18T18:44:22,125   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-12-18T18:44:22,127   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-12-18T18:44:22,128   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-12-18T18:44:22,131   creating build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,132   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,135   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,138   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,141   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,144   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,147   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,150   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,153   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-12-18T18:44:22,156   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,158   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,161   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,165   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,169   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,172   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,175   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,181   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,183   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,186   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,189   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:22,192   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-12-18T18:44:22,193   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-12-18T18:44:22,196   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-12-18T18:44:22,199   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-12-18T18:44:22,202   creating build/lib/deepspeed/ops/csrc/utils
2024-12-18T18:44:22,203   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-12-18T18:44:22,206   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-12-18T18:44:22,208   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-12-18T18:44:22,211   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-12-18T18:44:22,212   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-12-18T18:44:22,214   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-12-18T18:44:22,217   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-12-18T18:44:22,220   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-12-18T18:44:22,221   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-12-18T18:44:22,223   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:22,224   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:22,226   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:22,229   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:22,232   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:22,235   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:22,237   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-12-18T18:44:22,238   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-12-18T18:44:22,241   creating build/lib/deepspeed/autotuning/config_templates
2024-12-18T18:44:22,242   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-12-18T18:44:22,244   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-12-18T18:44:22,246   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-12-18T18:44:22,248   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-12-18T18:44:22,251   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,252   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,255   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,258   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,260   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,263   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,266   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-12-18T18:44:22,268   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-12-18T18:44:22,270   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-12-18T18:44:22,272   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-12-18T18:44:22,273   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-12-18T18:44:22,275   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-12-18T18:44:22,277   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-12-18T18:44:22,279   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-12-18T18:44:22,281   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-12-18T18:44:22,283   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-18T18:44:22,284   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-18T18:44:22,286   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-18T18:44:22,288   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-18T18:44:22,290   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-12-18T18:44:22,292   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-12-18T18:44:22,294   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-12-18T18:44:22,296   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,299   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,301   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,304   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,306   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,308   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,311   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,313   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,316   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,318   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,321   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,323   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,326   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,328   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,331   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,334   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,336   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,338   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,341   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,343   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,346   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:22,349   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:22,352   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,355   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,357   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,359   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,362   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,364   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,367   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,370   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,373   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,375   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,379   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,381   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,383   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,386   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,389   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:22,391   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:22,393   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:22,396   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:22,399   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:22,401   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:22,403   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:22,406   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:22,408   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:22,410   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:22,413   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:22,416   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:22,418   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:22,420   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:22,423   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:22,426   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:22,428   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:22,430   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:22,432   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:22,434   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:22,437   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:22,439   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:22,441   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:22,443   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:22,445   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:22,447   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:22,450   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:22,452   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:22,454   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:22,457   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:22,459   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:22,512   running build_scripts
2024-12-18T18:44:22,513   creating build/scripts-3.11
2024-12-18T18:44:22,514   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-12-18T18:44:22,516   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-12-18T18:44:22,517   copying and adjusting bin/ds -> build/scripts-3.11
2024-12-18T18:44:22,519   copying bin/ds_ssh -> build/scripts-3.11
2024-12-18T18:44:22,521   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-12-18T18:44:22,522   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-12-18T18:44:22,524   copying and adjusting bin/dsr -> build/scripts-3.11
2024-12-18T18:44:22,525   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-12-18T18:44:22,527   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2024-12-18T18:44:22,529   copying and adjusting bin/ds_io -> build/scripts-3.11
2024-12-18T18:44:22,529   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-12-18T18:44:22,530   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-12-18T18:44:22,530   changing mode of build/scripts-3.11/ds from 644 to 755
2024-12-18T18:44:22,531   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-12-18T18:44:22,532   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-12-18T18:44:22,532   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-12-18T18:44:22,533   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-12-18T18:44:22,533   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2024-12-18T18:44:22,534   changing mode of build/scripts-3.11/ds_io from 644 to 755
2024-12-18T18:44:22,561   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-12-18T18:44:22,562   !!

2024-12-18T18:44:22,563           ********************************************************************************
2024-12-18T18:44:22,564           Please avoid running ``setup.py`` directly.
2024-12-18T18:44:22,565           Instead, use pypa/build, pypa/installer or other
2024-12-18T18:44:22,566           standards-based tools.

2024-12-18T18:44:22,566           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-12-18T18:44:22,567           ********************************************************************************

2024-12-18T18:44:22,568   !!
2024-12-18T18:44:22,569     self.initialize_options()
2024-12-18T18:44:22,589   installing to build/bdist.linux-armv7l/wheel
2024-12-18T18:44:22,590   running install
2024-12-18T18:44:22,614   running install_lib
2024-12-18T18:44:22,642   creating build/bdist.linux-armv7l/wheel
2024-12-18T18:44:22,645   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-12-18T18:44:22,646   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-12-18T18:44:22,647   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-12-18T18:44:22,649   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-18T18:44:22,652   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-12-18T18:44:22,653   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,655   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,657   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,659   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,661   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,663   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,665   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,667   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,669   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-12-18T18:44:22,671   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-12-18T18:44:22,672   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-12-18T18:44:22,674   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-12-18T18:44:22,676   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-12-18T18:44:22,678   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-12-18T18:44:22,680   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-12-18T18:44:22,683   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-12-18T18:44:22,686   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-12-18T18:44:22,688   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-12-18T18:44:22,689   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-18T18:44:22,691   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-18T18:44:22,693   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-18T18:44:22,696   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-18T18:44:22,698   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-12-18T18:44:22,700   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-12-18T18:44:22,702   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-12-18T18:44:22,704   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-12-18T18:44:22,707   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-12-18T18:44:22,709   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:22,711   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-12-18T18:44:22,713   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-12-18T18:44:22,715   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-18T18:44:22,717   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-18T18:44:22,719   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-18T18:44:22,721   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-18T18:44:22,722   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-18T18:44:22,724   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-18T18:44:22,726   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-12-18T18:44:22,728   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-12-18T18:44:22,730   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-12-18T18:44:22,732   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-12-18T18:44:22,734   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-12-18T18:44:22,736   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-12-18T18:44:22,737   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-12-18T18:44:22,740   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-12-18T18:44:22,742   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-12-18T18:44:22,744   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-12-18T18:44:22,745   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-12-18T18:44:22,747   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-12-18T18:44:22,750   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-12-18T18:44:22,751   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-12-18T18:44:22,754   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-12-18T18:44:22,756   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-12-18T18:44:22,757   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-12-18T18:44:22,759   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-12-18T18:44:22,762   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-18T18:44:22,763   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-18T18:44:22,765   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-18T18:44:22,767   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-12-18T18:44:22,769   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-12-18T18:44:22,771   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-12-18T18:44:22,773   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-12-18T18:44:22,775   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-12-18T18:44:22,777   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,779   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,781   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,782   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,784   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,786   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,788   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,790   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,792   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-12-18T18:44:22,794   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-12-18T18:44:22,796   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-12-18T18:44:22,798   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-12-18T18:44:22,799   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-12-18T18:44:22,802   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-12-18T18:44:22,803   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-12-18T18:44:22,805   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-12-18T18:44:22,807   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-12-18T18:44:22,809   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-12-18T18:44:22,811   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:22,813   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:22,815   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:22,817   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:22,819   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:22,820   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:22,822   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:22,825   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-12-18T18:44:22,827   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,828   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,830   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,833   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,835   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,838   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-12-18T18:44:22,841   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-12-18T18:44:22,843   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,845   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,847   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,849   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,851   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,853   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,856   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,858   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,860   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,863   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,865   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,867   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,868   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-12-18T18:44:22,870   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,872   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,875   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,877   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-12-18T18:44:22,882   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,884   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,886   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,889   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,892   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,894   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-12-18T18:44:22,896   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,898   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,899   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,902   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,904   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,905   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-12-18T18:44:22,907   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-12-18T18:44:22,910   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:22,911   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:22,913   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:22,915   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:22,917   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-12-18T18:44:22,920   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-12-18T18:44:22,922   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,923   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,925   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,927   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,929   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,931   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,933   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,935   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-12-18T18:44:22,938   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,939   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,941   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,943   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,945   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,948   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,949   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,951   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,953   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-12-18T18:44:22,955   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-12-18T18:44:22,957   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-12-18T18:44:22,959   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-12-18T18:44:22,961   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,963   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,965   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,967   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,969   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,972   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,974   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,975   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,977   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-12-18T18:44:22,979   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-12-18T18:44:22,982   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,983   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,985   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,987   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,988   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,990   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,991   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-12-18T18:44:22,994   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-18T18:44:22,995   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-18T18:44:22,997   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-18T18:44:22,999   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-12-18T18:44:23,002   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:23,003   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:23,005   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:23,007   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:23,009   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:23,010   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:23,013   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-12-18T18:44:23,015   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:23,017   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:23,019   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:23,020   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:23,022   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-12-18T18:44:23,025   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-12-18T18:44:23,026   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-12-18T18:44:23,028   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:23,029   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:23,031   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:23,033   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:23,035   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:23,037   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:23,039   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-12-18T18:44:23,041   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-12-18T18:44:23,043   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:23,044   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:23,046   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:23,048   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:23,050   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:23,052   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:23,054   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-12-18T18:44:23,057   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:23,058   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:23,060   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:23,062   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:23,063   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:23,065   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:23,067   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-12-18T18:44:23,070   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:23,071   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:23,073   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:23,075   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:23,077   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:23,078   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:23,081   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-12-18T18:44:23,083   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-12-18T18:44:23,085   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-12-18T18:44:23,086   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-12-18T18:44:23,088   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-12-18T18:44:23,091   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:23,092   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:23,094   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:23,096   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:23,098   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:23,100   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-12-18T18:44:23,103   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:23,105   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:23,107   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:23,109   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:23,111   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:23,112   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:23,114   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-12-18T18:44:23,116   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-12-18T18:44:23,118   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-12-18T18:44:23,120   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-12-18T18:44:23,122   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-12-18T18:44:23,123   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-12-18T18:44:23,125   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-12-18T18:44:23,127   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-18T18:44:23,129   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-18T18:44:23,132   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-12-18T18:44:23,133   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-12-18T18:44:23,135   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-18T18:44:23,138   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-18T18:44:23,140   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-18T18:44:23,142   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-18T18:44:23,144   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-12-18T18:44:23,147   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-12-18T18:44:23,149   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:23,150   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:23,152   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:23,154   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:23,157   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-12-18T18:44:23,159   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:23,160   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:23,162   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:23,163   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:23,166   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-12-18T18:44:23,167   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-18T18:44:23,170   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:23,171   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:23,173   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:23,175   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:23,177   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-12-18T18:44:23,179   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:23,181   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:23,183   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:23,185   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:23,187   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-12-18T18:44:23,189   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-18T18:44:23,191   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-18T18:44:23,194   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:23,196   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:23,198   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:23,200   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:23,202   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-12-18T18:44:23,206   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,207   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,210   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,211   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,214   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,216   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,218   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,220   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,222   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,225   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-12-18T18:44:23,227   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:23,229   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:23,232   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:23,234   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:23,237   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-12-18T18:44:23,239   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:23,240   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:23,242   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:23,245   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:23,247   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-12-18T18:44:23,249   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-18T18:44:23,251   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-18T18:44:23,254   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,255   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,257   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,259   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,261   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,263   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,265   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,267   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,270   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,272   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-12-18T18:44:23,275   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:23,277   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:23,279   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:23,281   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:23,283   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-12-18T18:44:23,286   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:23,288   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:23,290   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:23,292   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:23,295   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-12-18T18:44:23,298   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:23,300   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:23,302   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:23,306   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:23,308   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-12-18T18:44:23,310   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-18T18:44:23,313   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-12-18T18:44:23,316   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-18T18:44:23,535   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-12-18T18:44:23,537   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,541   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,544   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,547   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,550   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,553   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,554   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,557   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,559   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,562   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-12-18T18:44:23,565   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-12-18T18:44:23,568   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-12-18T18:44:23,570   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-12-18T18:44:23,572   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-12-18T18:44:23,576   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-12-18T18:44:23,579   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:23,581   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:23,586   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:23,589   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:23,592   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-12-18T18:44:23,596   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-12-18T18:44:23,598   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-18T18:44:23,601   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-18T18:44:23,604   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-18T18:44:23,606   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-18T18:44:23,609   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-12-18T18:44:23,613   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-12-18T18:44:23,615   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-12-18T18:44:23,617   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-12-18T18:44:23,620   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-12-18T18:44:23,623   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-12-18T18:44:23,626   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-12-18T18:44:23,630   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-12-18T18:44:23,633   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-12-18T18:44:23,635   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-12-18T18:44:23,638   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-12-18T18:44:23,640   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-12-18T18:44:23,645   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-12-18T18:44:23,646   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-12-18T18:44:23,650   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:23,652   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:23,655   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:23,659   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:23,661   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:23,665   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-12-18T18:44:23,668   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-12-18T18:44:23,669   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-12-18T18:44:23,672   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-12-18T18:44:23,674   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-12-18T18:44:23,677   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-12-18T18:44:23,678   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-12-18T18:44:23,681   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,682   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,686   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,689   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,693   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-12-18T18:44:23,694   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,696   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,698   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,701   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,703   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,705   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,708   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,711   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,714   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,716   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,718   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-12-18T18:44:23,722   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-12-18T18:44:23,724   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-12-18T18:44:23,726   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-12-18T18:44:23,729   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-12-18T18:44:23,731   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,734   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,737   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,740   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,744   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-12-18T18:44:23,745   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-12-18T18:44:23,746   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-12-18T18:44:23,748   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-12-18T18:44:23,751   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-12-18T18:44:23,753   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,755   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,757   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,759   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,761   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,763   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,765   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,766   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,769   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,771   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,772   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,774   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,776   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,778   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,780   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,782   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,784   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,786   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-12-18T18:44:23,788   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-12-18T18:44:23,790   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-18T18:44:23,792   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-18T18:44:23,794   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-18T18:44:23,796   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-18T18:44:23,798   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-18T18:44:23,800   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-12-18T18:44:23,802   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-12-18T18:44:23,804   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-12-18T18:44:23,806   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-12-18T18:44:23,807   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-18T18:44:23,810   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-18T18:44:23,813   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-18T18:44:23,815   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-18T18:44:23,817   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-18T18:44:23,819   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-18T18:44:23,822   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-12-18T18:44:23,825   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-12-18T18:44:23,827   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,829   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,831   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,833   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,835   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,837   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,839   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,842   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,844   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,846   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,849   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,851   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,853   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,855   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,859   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,861   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,863   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,865   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,868   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,871   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,873   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,876   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,878   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,881   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,883   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,885   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,888   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,890   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,894   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-12-18T18:44:23,897   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-12-18T18:44:23,899   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:23,901   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:23,906   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:23,907   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:23,910   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:23,914   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:23,916   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:23,919   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:23,922   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:23,925   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-12-18T18:44:23,929   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:23,931   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:23,933   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:23,936   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:23,939   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-12-18T18:44:23,942   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:23,944   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:23,946   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:23,950   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:23,953   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:23,956   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:23,958   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:23,961   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-12-18T18:44:23,964   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:23,966   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:23,969   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:23,972   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:23,976   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-18T18:44:23,978   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-18T18:44:23,981   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-12-18T18:44:23,983   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-12-18T18:44:23,986   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-12-18T18:44:23,989   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-12-18T18:44:23,990   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-12-18T18:44:23,993   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:23,995   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:23,998   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:24,000   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:24,003   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-12-18T18:44:24,006   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-12-18T18:44:24,007   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-12-18T18:44:24,010   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-12-18T18:44:24,012   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-12-18T18:44:24,015   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-12-18T18:44:24,017   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-12-18T18:44:24,019   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2024-12-18T18:44:24,021   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:24,024   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:24,026   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:24,028   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:24,031   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:24,033   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:24,036   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-12-18T18:44:24,039   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-12-18T18:44:24,041   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-18T18:44:24,043   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-18T18:44:24,046   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-18T18:44:24,048   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-18T18:44:24,050   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-12-18T18:44:24,053   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-12-18T18:44:24,055   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-12-18T18:44:24,057   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-12-18T18:44:24,059   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-12-18T18:44:24,062   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-12-18T18:44:24,063   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-12-18T18:44:24,067   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-12-18T18:44:24,068   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-12-18T18:44:24,071   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-12-18T18:44:24,073   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-12-18T18:44:24,075   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-12-18T18:44:24,078   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-12-18T18:44:24,079   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-12-18T18:44:24,082   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-12-18T18:44:24,085   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-12-18T18:44:24,088   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-12-18T18:44:24,089   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-12-18T18:44:24,092   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-12-18T18:44:24,095   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-12-18T18:44:24,097   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-12-18T18:44:24,099   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,102   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,103   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,106   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,108   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,109   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,112   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,114   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,117   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,119   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,121   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,124   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-12-18T18:44:24,127   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,128   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,130   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,133   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,135   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,137   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,139   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,141   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,143   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,145   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,147   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,149   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,151   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,153   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,155   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,157   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,159   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,161   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,164   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,166   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,168   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,170   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,172   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,175   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-12-18T18:44:24,177   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,179   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,181   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,184   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,186   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,187   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,189   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,191   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,194   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-12-18T18:44:24,197   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-12-18T18:44:24,199   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-12-18T18:44:24,202   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-12-18T18:44:24,203   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-12-18T18:44:24,205   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-12-18T18:44:24,208   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-12-18T18:44:24,209   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-12-18T18:44:24,211   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-12-18T18:44:24,212   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-12-18T18:44:24,215   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-12-18T18:44:24,217   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-12-18T18:44:24,219   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-18T18:44:24,221   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:24,223   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:24,225   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:24,227   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:24,229   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-12-18T18:44:24,231   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-18T18:44:24,233   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-18T18:44:24,235   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-18T18:44:24,237   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-18T18:44:24,240   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-18T18:44:24,243   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-12-18T18:44:24,246   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-12-18T18:44:24,247   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,250   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,251   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,253   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,255   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,257   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,259   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,261   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,263   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,264   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,266   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-12-18T18:44:24,269   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,271   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,273   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,275   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,277   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,278   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,280   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,282   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,284   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,286   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,287   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,289   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-12-18T18:44:24,291   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,293   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,295   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,297   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,299   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,301   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,302   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,304   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,306   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,310   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-12-18T18:44:24,311   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-18T18:44:24,314   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-18T18:44:24,316   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-18T18:44:24,318   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-18T18:44:24,320   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-18T18:44:24,322   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-18T18:44:24,323   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-12-18T18:44:24,325   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,327   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,330   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,332   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,334   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,335   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,338   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-12-18T18:44:24,339   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-18T18:44:24,341   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-18T18:44:24,343   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-18T18:44:24,344   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-18T18:44:24,346   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-18T18:44:24,348   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-12-18T18:44:24,350   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,351   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,353   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,355   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,357   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,359   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,361   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2024-12-18T18:44:24,363   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-18T18:44:24,365   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-18T18:44:24,367   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-18T18:44:24,368   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-18T18:44:24,370   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-18T18:44:24,372   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-12-18T18:44:24,374   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-12-18T18:44:24,377   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-12-18T18:44:24,379   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2024-12-18T18:44:24,381   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2024-12-18T18:44:24,384   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-12-18T18:44:24,386   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-12-18T18:44:24,389   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-12-18T18:44:24,391   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-12-18T18:44:24,394   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-12-18T18:44:24,396   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-12-18T18:44:24,398   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-12-18T18:44:24,400   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-12-18T18:44:24,403   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-12-18T18:44:24,405   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,408   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,411   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,413   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,416   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,419   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,421   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,424   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,426   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,429   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-12-18T18:44:24,433   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-12-18T18:44:24,434   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-18T18:44:24,437   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-18T18:44:24,439   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-18T18:44:24,442   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-18T18:44:24,446   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-18T18:44:24,449   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-18T18:44:24,452   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-18T18:44:24,455   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-12-18T18:44:24,459   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-12-18T18:44:24,461   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-12-18T18:44:24,466   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-12-18T18:44:24,469   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-12-18T18:44:24,471   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-12-18T18:44:24,473   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-18T18:44:24,476   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-12-18T18:44:24,478   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,480   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,482   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,484   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,487   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,488   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,490   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,493   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,495   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,497   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,499   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,501   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,503   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,505   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,507   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,509   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,511   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,513   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-12-18T18:44:24,515   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-12-18T18:44:24,517   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,519   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,521   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,523   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,525   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,527   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,530   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,532   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,534   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,535   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,539   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-12-18T18:44:24,540   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,542   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,544   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,546   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,548   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,550   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,552   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,554   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,556   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,558   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,560   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,561   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,563   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,566   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,568   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,570   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,572   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,574   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,576   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-12-18T18:44:24,579   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-12-18T18:44:24,581   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-18T18:44:24,583   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-18T18:44:24,585   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-18T18:44:24,588   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-18T18:44:24,589   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-18T18:44:24,591   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-18T18:44:24,594   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-12-18T18:44:24,595   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,598   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,599   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-12-18T18:44:24,603   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-12-18T18:44:24,604   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-18T18:44:24,606   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-18T18:44:24,608   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-18T18:44:24,610   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-18T18:44:24,613   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-18T18:44:24,615   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-12-18T18:44:24,617   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-18T18:44:24,619   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-12-18T18:44:24,620   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-18T18:44:24,624   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-12-18T18:44:24,626   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-18T18:44:24,628   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-18T18:44:24,630   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-18T18:44:24,631   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-18T18:44:24,633   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-18T18:44:24,635   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-12-18T18:44:24,638   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-18T18:44:24,640   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-18T18:44:24,642   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-18T18:44:24,644   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-18T18:44:24,646   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-12-18T18:44:24,649   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-12-18T18:44:24,650   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-12-18T18:44:24,652   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-12-18T18:44:24,654   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-12-18T18:44:24,656   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-12-18T18:44:24,658   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-12-18T18:44:24,659   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-18T18:44:24,662   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-18T18:44:24,665   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-18T18:44:24,666   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-18T18:44:24,668   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-18T18:44:24,670   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-12-18T18:44:24,672   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-12-18T18:44:24,673   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-18T18:44:24,676   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-18T18:44:24,678   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-18T18:44:24,679   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-18T18:44:24,681   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-12-18T18:44:24,685   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-12-18T18:44:24,686   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-18T18:44:24,689   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-18T18:44:24,691   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-18T18:44:24,694   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-18T18:44:24,695   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-18T18:44:24,697   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-12-18T18:44:24,699   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-12-18T18:44:24,702   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-12-18T18:44:24,703   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-12-18T18:44:24,705   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-12-18T18:44:24,707   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-12-18T18:44:24,709   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-12-18T18:44:24,711   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-12-18T18:44:24,712   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,714   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,716   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,718   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,720   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,722   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,723   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,725   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,727   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,729   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-12-18T18:44:24,730   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-12-18T18:44:24,733   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-12-18T18:44:24,734   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-12-18T18:44:24,736   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-12-18T18:44:24,738   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-12-18T18:44:24,740   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-12-18T18:44:24,742   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-12-18T18:44:24,743   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-12-18T18:44:24,746   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-12-18T18:44:24,747   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-18T18:44:24,749   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-18T18:44:24,751   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-18T18:44:24,753   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-18T18:44:24,755   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-18T18:44:24,757   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-18T18:44:24,759   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-18T18:44:24,761   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-12-18T18:44:24,763   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-12-18T18:44:24,766   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-12-18T18:44:24,774   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-18T18:44:24,777   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-18T18:44:24,780   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-18T18:44:24,782   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-18T18:44:24,785   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-18T18:44:24,788   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-12-18T18:44:24,791   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-12-18T18:44:24,792   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-18T18:44:24,794   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-18T18:44:24,797   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-18T18:44:24,799   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-18T18:44:24,801   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-18T18:44:24,803   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-12-18T18:44:24,806   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-12-18T18:44:24,807   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-12-18T18:44:24,810   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:24,811   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:24,813   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:24,815   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:24,817   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:24,819   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-12-18T18:44:24,822   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:24,823   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:24,826   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:24,829   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:24,832   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:24,834   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-12-18T18:44:24,836   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-12-18T18:44:24,838   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-12-18T18:44:24,840   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-12-18T18:44:24,842   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,845   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-12-18T18:44:24,846   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,849   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,851   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,855   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,861   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,863   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,866   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,868   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,871   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,873   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,876   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,878   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,880   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,883   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,885   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,888   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,890   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-12-18T18:44:24,894   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,898   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,899   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,901   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,904   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,907   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,910   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,912   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,914   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,916   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,919   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-12-18T18:44:24,922   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:24,923   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:24,925   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:24,927   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:24,929   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-12-18T18:44:24,931   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-12-18T18:44:24,933   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-12-18T18:44:24,934   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-12-18T18:44:24,936   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,939   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,941   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,943   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,945   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,948   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-12-18T18:44:24,950   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-12-18T18:44:24,953   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-12-18T18:44:24,955   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-12-18T18:44:24,958   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-12-18T18:44:24,959   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-12-18T18:44:24,963   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-12-18T18:44:24,965   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-12-18T18:44:24,968   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-12-18T18:44:24,971   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-12-18T18:44:24,974   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,977   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,979   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,982   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2024-12-18T18:44:24,983   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2024-12-18T18:44:24,986   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2024-12-18T18:44:24,988   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,992   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:24,994   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:25,001   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:25,005   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:25,007   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:25,010   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:25,013   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-12-18T18:44:25,017   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-12-18T18:44:25,018   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-12-18T18:44:25,022   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-12-18T18:44:25,024   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-12-18T18:44:25,027   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2024-12-18T18:44:25,029   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,032   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,034   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,036   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,038   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,041   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,043   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,046   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,048   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,050   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,053   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,055   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-12-18T18:44:25,058   running install_egg_info
2024-12-18T18:44:25,092   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.2-py3.11.egg-info
2024-12-18T18:44:25,107   running install_scripts
2024-12-18T18:44:25,109   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,111   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,114   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,116   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,118   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,120   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,122   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,124   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,126   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,128   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,130   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts
2024-12-18T18:44:25,131   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/ds_elastic to 755
2024-12-18T18:44:25,132   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/ds_ssh to 755
2024-12-18T18:44:25,133   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/ds_nvme_tune to 755
2024-12-18T18:44:25,134   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/ds_report to 755
2024-12-18T18:44:25,134   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/ds_bench to 755
2024-12-18T18:44:25,135   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/ds to 755
2024-12-18T18:44:25,136   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/ds_io to 755
2024-12-18T18:44:25,137   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/deepspeed.pt to 755
2024-12-18T18:44:25,137   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/deepspeed to 755
2024-12-18T18:44:25,138   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.data/scripts/dsr to 755
2024-12-18T18:44:25,189   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.2.dist-info/WHEEL
2024-12-18T18:44:25,192   creating '/tmp/pip-wheel-t_583i1m/deepspeed-0.16.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-12-18T18:44:25,196   adding 'deepspeed/__init__.py'
2024-12-18T18:44:25,198   adding 'deepspeed/constants.py'
2024-12-18T18:44:25,200   adding 'deepspeed/env_report.py'
2024-12-18T18:44:25,202   adding 'deepspeed/git_version_info.py'
2024-12-18T18:44:25,203   adding 'deepspeed/git_version_info_installed.py'
2024-12-18T18:44:25,205   adding 'deepspeed/accelerator/__init__.py'
2024-12-18T18:44:25,207   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-12-18T18:44:25,210   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-12-18T18:44:25,212   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-12-18T18:44:25,215   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-12-18T18:44:25,217   adding 'deepspeed/accelerator/mlu_accelerator.py'
2024-12-18T18:44:25,219   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-12-18T18:44:25,221   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-12-18T18:44:25,223   adding 'deepspeed/accelerator/real_accelerator.py'
2024-12-18T18:44:25,225   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-12-18T18:44:25,227   adding 'deepspeed/autotuning/__init__.py'
2024-12-18T18:44:25,233   adding 'deepspeed/autotuning/autotuner.py'
2024-12-18T18:44:25,235   adding 'deepspeed/autotuning/config.py'
2024-12-18T18:44:25,237   adding 'deepspeed/autotuning/constants.py'
2024-12-18T18:44:25,240   adding 'deepspeed/autotuning/scheduler.py'
2024-12-18T18:44:25,243   adding 'deepspeed/autotuning/utils.py'
2024-12-18T18:44:25,245   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-12-18T18:44:25,247   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-12-18T18:44:25,248   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-12-18T18:44:25,250   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-12-18T18:44:25,252   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-12-18T18:44:25,253   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-12-18T18:44:25,255   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-12-18T18:44:25,257   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-12-18T18:44:25,259   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-12-18T18:44:25,260   adding 'deepspeed/autotuning/tuner/utils.py'
2024-12-18T18:44:25,262   adding 'deepspeed/checkpoint/__init__.py'
2024-12-18T18:44:25,264   adding 'deepspeed/checkpoint/constants.py'
2024-12-18T18:44:25,267   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-12-18T18:44:25,270   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-12-18T18:44:25,272   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-12-18T18:44:25,274   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-12-18T18:44:25,275   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-12-18T18:44:25,277   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-12-18T18:44:25,278   adding 'deepspeed/checkpoint/utils.py'
2024-12-18T18:44:25,280   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-12-18T18:44:25,282   adding 'deepspeed/comm/__init__.py'
2024-12-18T18:44:25,283   adding 'deepspeed/comm/backend.py'
2024-12-18T18:44:25,284   adding 'deepspeed/comm/ccl.py'
2024-12-18T18:44:25,288   adding 'deepspeed/comm/comm.py'
2024-12-18T18:44:25,289   adding 'deepspeed/comm/config.py'
2024-12-18T18:44:25,290   adding 'deepspeed/comm/constants.py'
2024-12-18T18:44:25,291   adding 'deepspeed/comm/reduce_op.py'
2024-12-18T18:44:25,294   adding 'deepspeed/comm/torch.py'
2024-12-18T18:44:25,295   adding 'deepspeed/comm/utils.py'
2024-12-18T18:44:25,297   adding 'deepspeed/compression/__init__.py'
2024-12-18T18:44:25,300   adding 'deepspeed/compression/basic_layer.py'
2024-12-18T18:44:25,302   adding 'deepspeed/compression/compress.py'
2024-12-18T18:44:25,304   adding 'deepspeed/compression/config.py'
2024-12-18T18:44:25,306   adding 'deepspeed/compression/constants.py'
2024-12-18T18:44:25,308   adding 'deepspeed/compression/helper.py'
2024-12-18T18:44:25,309   adding 'deepspeed/compression/scheduler.py'
2024-12-18T18:44:25,311   adding 'deepspeed/compression/utils.py'
2024-12-18T18:44:25,313   adding 'deepspeed/elasticity/__init__.py'
2024-12-18T18:44:25,314   adding 'deepspeed/elasticity/config.py'
2024-12-18T18:44:25,315   adding 'deepspeed/elasticity/constants.py'
2024-12-18T18:44:25,317   adding 'deepspeed/elasticity/elastic_agent.py'
2024-12-18T18:44:25,320   adding 'deepspeed/elasticity/elasticity.py'
2024-12-18T18:44:25,321   adding 'deepspeed/elasticity/utils.py'
2024-12-18T18:44:25,323   adding 'deepspeed/inference/__init__.py'
2024-12-18T18:44:25,325   adding 'deepspeed/inference/config.py'
2024-12-18T18:44:25,328   adding 'deepspeed/inference/engine.py'
2024-12-18T18:44:25,330   adding 'deepspeed/inference/quantization/__init__.py'
2024-12-18T18:44:25,332   adding 'deepspeed/inference/quantization/layers.py'
2024-12-18T18:44:25,333   adding 'deepspeed/inference/quantization/quantization.py'
2024-12-18T18:44:25,335   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-12-18T18:44:25,337   adding 'deepspeed/inference/quantization/utils.py'
2024-12-18T18:44:25,338   adding 'deepspeed/inference/v2/__init__.py'
2024-12-18T18:44:25,340   adding 'deepspeed/inference/v2/allocator.py'
2024-12-18T18:44:25,341   adding 'deepspeed/inference/v2/config_v2.py'
2024-12-18T18:44:25,343   adding 'deepspeed/inference/v2/engine_factory.py'
2024-12-18T18:44:25,345   adding 'deepspeed/inference/v2/engine_v2.py'
2024-12-18T18:44:25,346   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-12-18T18:44:25,347   adding 'deepspeed/inference/v2/inference_utils.py'
2024-12-18T18:44:25,348   adding 'deepspeed/inference/v2/logging.py'
2024-12-18T18:44:25,350   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-12-18T18:44:25,351   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-12-18T18:44:25,352   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-12-18T18:44:25,354   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-12-18T18:44:25,355   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-12-18T18:44:25,357   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-12-18T18:44:25,358   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-12-18T18:44:25,360   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-12-18T18:44:25,361   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-12-18T18:44:25,363   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-12-18T18:44:25,364   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-12-18T18:44:25,365   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-12-18T18:44:25,367   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-12-18T18:44:25,368   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-12-18T18:44:25,370   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-12-18T18:44:25,371   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-12-18T18:44:25,373   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-12-18T18:44:25,375   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-12-18T18:44:25,376   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-12-18T18:44:25,378   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-12-18T18:44:25,379   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-12-18T18:44:25,380   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-12-18T18:44:25,381   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-12-18T18:44:25,382   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-12-18T18:44:25,384   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-12-18T18:44:25,386   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-12-18T18:44:25,388   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-12-18T18:44:25,389   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-12-18T18:44:25,391   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-12-18T18:44:25,392   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-12-18T18:44:25,394   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-12-18T18:44:25,396   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-12-18T18:44:25,398   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-12-18T18:44:25,400   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-12-18T18:44:25,402   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-12-18T18:44:25,403   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-12-18T18:44:25,405   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-12-18T18:44:25,406   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-12-18T18:44:25,408   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-12-18T18:44:25,409   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-12-18T18:44:25,411   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-12-18T18:44:25,413   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-12-18T18:44:25,414   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-12-18T18:44:25,415   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-12-18T18:44:25,417   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-12-18T18:44:25,418   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-12-18T18:44:25,419   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-12-18T18:44:25,421   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-12-18T18:44:25,422   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-12-18T18:44:25,423   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-12-18T18:44:25,425   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-12-18T18:44:25,426   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-12-18T18:44:25,428   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-12-18T18:44:25,429   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-12-18T18:44:25,430   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-12-18T18:44:25,432   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-12-18T18:44:25,433   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-12-18T18:44:25,434   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-12-18T18:44:25,436   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-12-18T18:44:25,437   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-12-18T18:44:25,439   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-12-18T18:44:25,440   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-12-18T18:44:25,442   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-12-18T18:44:25,443   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-12-18T18:44:25,444   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-12-18T18:44:25,445   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-12-18T18:44:25,447   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-12-18T18:44:25,449   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-12-18T18:44:25,451   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-12-18T18:44:25,452   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-12-18T18:44:25,454   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-12-18T18:44:25,457   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-12-18T18:44:25,459   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-12-18T18:44:25,461   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-12-18T18:44:25,462   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-12-18T18:44:25,464   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-12-18T18:44:25,465   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-12-18T18:44:25,466   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-12-18T18:44:25,468   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-12-18T18:44:25,469   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-12-18T18:44:25,471   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-12-18T18:44:25,472   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-12-18T18:44:25,473   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-12-18T18:44:25,474   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-12-18T18:44:25,476   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-12-18T18:44:25,478   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-12-18T18:44:25,479   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-12-18T18:44:25,480   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-12-18T18:44:25,481   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-12-18T18:44:25,483   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-12-18T18:44:25,484   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-12-18T18:44:25,486   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-12-18T18:44:25,488   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-12-18T18:44:25,489   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-12-18T18:44:25,490   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-12-18T18:44:25,492   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-12-18T18:44:25,494   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-12-18T18:44:25,495   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-12-18T18:44:25,497   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-12-18T18:44:25,499   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-12-18T18:44:25,500   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-12-18T18:44:25,501   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-12-18T18:44:25,503   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-12-18T18:44:25,504   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-12-18T18:44:25,505   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-12-18T18:44:25,507   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-12-18T18:44:25,508   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-12-18T18:44:25,509   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-12-18T18:44:25,511   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-12-18T18:44:25,512   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-12-18T18:44:25,514   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-12-18T18:44:25,515   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-12-18T18:44:25,517   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-12-18T18:44:25,518   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-12-18T18:44:25,519   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-12-18T18:44:25,521   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-12-18T18:44:25,523   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-12-18T18:44:25,525   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-12-18T18:44:25,527   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-12-18T18:44:25,528   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-12-18T18:44:25,530   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-12-18T18:44:25,531   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-12-18T18:44:25,532   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-12-18T18:44:25,533   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-12-18T18:44:25,534   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-12-18T18:44:25,536   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-12-18T18:44:25,538   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-12-18T18:44:25,539   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-12-18T18:44:25,541   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-12-18T18:44:25,543   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-12-18T18:44:25,546   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-12-18T18:44:25,548   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-12-18T18:44:25,550   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-12-18T18:44:25,552   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-12-18T18:44:25,553   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-12-18T18:44:25,554   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-12-18T18:44:25,555   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-12-18T18:44:25,557   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-12-18T18:44:25,558   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-12-18T18:44:25,559   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-12-18T18:44:25,561   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-12-18T18:44:25,562   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-12-18T18:44:25,564   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-12-18T18:44:25,565   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-12-18T18:44:25,567   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-12-18T18:44:25,568   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-12-18T18:44:25,570   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-12-18T18:44:25,571   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-12-18T18:44:25,573   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-12-18T18:44:25,574   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-12-18T18:44:25,576   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-12-18T18:44:25,577   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-12-18T18:44:25,579   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-12-18T18:44:25,580   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-12-18T18:44:25,582   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-12-18T18:44:25,583   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-12-18T18:44:25,585   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-12-18T18:44:25,586   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-12-18T18:44:25,587   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-12-18T18:44:25,589   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-12-18T18:44:25,590   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-12-18T18:44:25,591   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-12-18T18:44:25,593   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-12-18T18:44:25,594   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-12-18T18:44:25,596   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-12-18T18:44:25,597   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-12-18T18:44:25,599   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-12-18T18:44:25,600   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-12-18T18:44:25,602   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-12-18T18:44:25,603   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-12-18T18:44:25,605   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-12-18T18:44:25,606   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-12-18T18:44:25,608   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-12-18T18:44:25,609   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-12-18T18:44:25,611   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-12-18T18:44:25,612   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-12-18T18:44:25,614   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-12-18T18:44:25,615   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-12-18T18:44:25,617   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-12-18T18:44:25,618   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-12-18T18:44:25,620   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-12-18T18:44:25,621   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-12-18T18:44:25,623   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-12-18T18:44:25,624   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-12-18T18:44:25,626   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-12-18T18:44:25,627   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-12-18T18:44:25,628   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-12-18T18:44:25,630   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-12-18T18:44:25,631   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-12-18T18:44:25,632   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-12-18T18:44:25,634   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-12-18T18:44:25,636   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-12-18T18:44:25,637   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-12-18T18:44:25,639   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-12-18T18:44:25,640   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-12-18T18:44:25,642   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-12-18T18:44:25,643   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-12-18T18:44:25,645   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-12-18T18:44:25,646   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-12-18T18:44:25,647   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-12-18T18:44:25,649   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-12-18T18:44:25,650   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-12-18T18:44:25,652   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-12-18T18:44:25,653   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-12-18T18:44:25,655   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-12-18T18:44:25,656   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-12-18T18:44:25,658   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-12-18T18:44:25,659   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-12-18T18:44:25,661   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-12-18T18:44:25,662   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-12-18T18:44:25,664   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-12-18T18:44:25,666   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-12-18T18:44:25,667   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-12-18T18:44:25,668   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-12-18T18:44:25,670   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-12-18T18:44:25,671   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-12-18T18:44:25,673   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-12-18T18:44:25,674   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-12-18T18:44:25,676   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-12-18T18:44:25,678   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-12-18T18:44:25,679   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-12-18T18:44:25,680   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-12-18T18:44:25,682   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-12-18T18:44:25,683   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-12-18T18:44:25,684   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-12-18T18:44:25,686   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-12-18T18:44:25,687   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-12-18T18:44:25,689   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-12-18T18:44:25,690   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-12-18T18:44:25,692   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-12-18T18:44:25,694   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-12-18T18:44:25,695   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-12-18T18:44:25,697   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-12-18T18:44:25,699   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-12-18T18:44:25,701   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-12-18T18:44:25,702   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-12-18T18:44:25,704   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-12-18T18:44:25,706   adding 'deepspeed/launcher/__init__.py'
2024-12-18T18:44:25,707   adding 'deepspeed/launcher/constants.py'
2024-12-18T18:44:25,709   adding 'deepspeed/launcher/launch.py'
2024-12-18T18:44:25,710   adding 'deepspeed/launcher/launcher_helper.py'
2024-12-18T18:44:25,713   adding 'deepspeed/launcher/multinode_runner.py'
2024-12-18T18:44:25,716   adding 'deepspeed/launcher/runner.py'
2024-12-18T18:44:25,718   adding 'deepspeed/linear/__init__.py'
2024-12-18T18:44:25,719   adding 'deepspeed/linear/config.py'
2024-12-18T18:44:25,721   adding 'deepspeed/linear/context_manager.py'
2024-12-18T18:44:25,723   adding 'deepspeed/linear/optimized_linear.py'
2024-12-18T18:44:25,724   adding 'deepspeed/linear/quantization.py'
2024-12-18T18:44:25,726   adding 'deepspeed/model_implementations/__init__.py'
2024-12-18T18:44:25,727   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-12-18T18:44:25,729   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-12-18T18:44:25,730   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-12-18T18:44:25,731   adding 'deepspeed/model_implementations/features/__init__.py'
2024-12-18T18:44:25,733   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-12-18T18:44:25,735   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-12-18T18:44:25,736   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-12-18T18:44:25,738   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-12-18T18:44:25,739   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-12-18T18:44:25,740   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-12-18T18:44:25,741   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-12-18T18:44:25,742   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-12-18T18:44:25,744   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-12-18T18:44:25,745   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-12-18T18:44:25,747   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-12-18T18:44:25,748   adding 'deepspeed/module_inject/__init__.py'
2024-12-18T18:44:25,751   adding 'deepspeed/module_inject/auto_tp.py'
2024-12-18T18:44:25,753   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-12-18T18:44:25,755   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-12-18T18:44:25,756   adding 'deepspeed/module_inject/inject.py'
2024-12-18T18:44:25,758   adding 'deepspeed/module_inject/layers.py'
2024-12-18T18:44:25,760   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-12-18T18:44:25,761   adding 'deepspeed/module_inject/module_quantize.py'
2024-12-18T18:44:25,763   adding 'deepspeed/module_inject/policy.py'
2024-12-18T18:44:25,767   adding 'deepspeed/module_inject/replace_module.py'
2024-12-18T18:44:25,768   adding 'deepspeed/module_inject/replace_policy.py'
2024-12-18T18:44:25,769   adding 'deepspeed/module_inject/tp_shard.py'
2024-12-18T18:44:25,771   adding 'deepspeed/module_inject/utils.py'
2024-12-18T18:44:25,773   adding 'deepspeed/module_inject/containers/__init__.py'
2024-12-18T18:44:25,775   adding 'deepspeed/module_inject/containers/base.py'
2024-12-18T18:44:25,776   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-12-18T18:44:25,777   adding 'deepspeed/module_inject/containers/bert.py'
2024-12-18T18:44:25,779   adding 'deepspeed/module_inject/containers/bloom.py'
2024-12-18T18:44:25,780   adding 'deepspeed/module_inject/containers/clip.py'
2024-12-18T18:44:25,782   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-12-18T18:44:25,783   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-12-18T18:44:25,784   adding 'deepspeed/module_inject/containers/gptj.py'
2024-12-18T18:44:25,786   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-12-18T18:44:25,788   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-12-18T18:44:25,796   adding 'deepspeed/module_inject/containers/internlm.py'
2024-12-18T18:44:25,798   adding 'deepspeed/module_inject/containers/llama.py'
2024-12-18T18:44:25,799   adding 'deepspeed/module_inject/containers/llama2.py'
2024-12-18T18:44:25,801   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-12-18T18:44:25,803   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-12-18T18:44:25,805   adding 'deepspeed/module_inject/containers/opt.py'
2024-12-18T18:44:25,807   adding 'deepspeed/module_inject/containers/unet.py'
2024-12-18T18:44:25,808   adding 'deepspeed/module_inject/containers/vae.py'
2024-12-18T18:44:25,810   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-12-18T18:44:25,811   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-12-18T18:44:25,813   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-12-18T18:44:25,814   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-12-18T18:44:25,815   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-12-18T18:44:25,817   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-12-18T18:44:25,818   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-12-18T18:44:25,820   adding 'deepspeed/moe/__init__.py'
2024-12-18T18:44:25,821   adding 'deepspeed/moe/experts.py'
2024-12-18T18:44:25,823   adding 'deepspeed/moe/layer.py'
2024-12-18T18:44:25,824   adding 'deepspeed/moe/mappings.py'
2024-12-18T18:44:25,827   adding 'deepspeed/moe/sharded_moe.py'
2024-12-18T18:44:25,829   adding 'deepspeed/moe/utils.py'
2024-12-18T18:44:25,830   adding 'deepspeed/monitor/__init__.py'
2024-12-18T18:44:25,832   adding 'deepspeed/monitor/comet.py'
2024-12-18T18:44:25,833   adding 'deepspeed/monitor/config.py'
2024-12-18T18:44:25,835   adding 'deepspeed/monitor/csv_monitor.py'
2024-12-18T18:44:25,836   adding 'deepspeed/monitor/monitor.py'
2024-12-18T18:44:25,837   adding 'deepspeed/monitor/tensorboard.py'
2024-12-18T18:44:25,838   adding 'deepspeed/monitor/utils.py'
2024-12-18T18:44:25,839   adding 'deepspeed/monitor/wandb.py'
2024-12-18T18:44:25,841   adding 'deepspeed/nebula/__init__.py'
2024-12-18T18:44:25,842   adding 'deepspeed/nebula/config.py'
2024-12-18T18:44:25,843   adding 'deepspeed/nebula/constants.py'
2024-12-18T18:44:25,845   adding 'deepspeed/nvme/__init__.py'
2024-12-18T18:44:25,847   adding 'deepspeed/nvme/ds_aio_args.py'
2024-12-18T18:44:25,848   adding 'deepspeed/nvme/ds_aio_basic.py'
2024-12-18T18:44:25,850   adding 'deepspeed/nvme/ds_aio_handle.py'
2024-12-18T18:44:25,851   adding 'deepspeed/nvme/ds_aio_job.py'
2024-12-18T18:44:25,852   adding 'deepspeed/nvme/parse_nvme_stats.py'
2024-12-18T18:44:25,854   adding 'deepspeed/nvme/perf_generate_param.py'
2024-12-18T18:44:25,856   adding 'deepspeed/nvme/perf_run_sweep.py'
2024-12-18T18:44:25,857   adding 'deepspeed/nvme/perf_sweep_utils.py'
2024-12-18T18:44:25,858   adding 'deepspeed/nvme/test_ds_aio.py'
2024-12-18T18:44:25,859   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2024-12-18T18:44:25,861   adding 'deepspeed/nvme/validate_async_io.py'
2024-12-18T18:44:25,862   adding 'deepspeed/ops/__init__.py'
2024-12-18T18:44:25,864   adding 'deepspeed/ops/adagrad/__init__.py'
2024-12-18T18:44:25,865   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-12-18T18:44:25,867   adding 'deepspeed/ops/adam/__init__.py'
2024-12-18T18:44:25,869   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-12-18T18:44:25,870   adding 'deepspeed/ops/adam/fused_adam.py'
2024-12-18T18:44:25,872   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-12-18T18:44:25,873   adding 'deepspeed/ops/aio/__init__.py'
2024-12-18T18:44:25,876   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-12-18T18:44:25,878   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-12-18T18:44:25,879   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-12-18T18:44:25,880   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-12-18T18:44:25,882   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-12-18T18:44:25,884   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-12-18T18:44:25,887   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-12-18T18:44:25,888   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-12-18T18:44:25,889   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-12-18T18:44:25,891   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-12-18T18:44:25,892   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-12-18T18:44:25,893   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-12-18T18:44:25,895   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2024-12-18T18:44:25,896   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2024-12-18T18:44:25,897   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-12-18T18:44:25,899   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-12-18T18:44:25,900   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2024-12-18T18:44:25,901   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2024-12-18T18:44:25,902   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-12-18T18:44:25,903   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-12-18T18:44:25,904   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-12-18T18:44:25,906   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-12-18T18:44:25,907   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-12-18T18:44:25,908   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-12-18T18:44:25,909   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-12-18T18:44:25,910   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-12-18T18:44:25,912   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2024-12-18T18:44:25,913   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2024-12-18T18:44:25,915   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-12-18T18:44:25,916   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-12-18T18:44:25,918   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-12-18T18:44:25,921   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-12-18T18:44:25,924   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-12-18T18:44:25,925   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-12-18T18:44:25,926   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-12-18T18:44:25,928   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-12-18T18:44:25,930   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-12-18T18:44:25,932   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-12-18T18:44:25,934   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-12-18T18:44:25,936   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-12-18T18:44:25,944   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-12-18T18:44:25,949   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-12-18T18:44:25,951   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-12-18T18:44:25,954   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-12-18T18:44:25,955   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-12-18T18:44:25,957   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-12-18T18:44:25,959   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-12-18T18:44:25,961   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-12-18T18:44:25,964   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-12-18T18:44:25,966   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-12-18T18:44:25,968   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-12-18T18:44:25,970   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-12-18T18:44:25,977   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-12-18T18:44:25,981   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-12-18T18:44:25,982   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-12-18T18:44:25,986   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-12-18T18:44:25,990   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-12-18T18:44:25,994   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-12-18T18:44:25,995   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-12-18T18:44:25,997   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-12-18T18:44:25,999   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-12-18T18:44:26,000   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-12-18T18:44:26,002   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-12-18T18:44:26,005   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-12-18T18:44:26,006   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-12-18T18:44:26,008   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-12-18T18:44:26,010   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2024-12-18T18:44:26,011   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2024-12-18T18:44:26,013   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2024-12-18T18:44:26,014   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2024-12-18T18:44:26,016   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2024-12-18T18:44:26,017   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2024-12-18T18:44:26,019   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-12-18T18:44:26,021   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-12-18T18:44:26,022   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-12-18T18:44:26,023   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-12-18T18:44:26,025   adding 'deepspeed/ops/csrc/includes/context.h'
2024-12-18T18:44:26,026   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-12-18T18:44:26,028   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-12-18T18:44:26,029   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-12-18T18:44:26,031   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-12-18T18:44:26,032   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-12-18T18:44:26,034   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-12-18T18:44:26,035   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-12-18T18:44:26,037   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-12-18T18:44:26,038   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-12-18T18:44:26,040   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-12-18T18:44:26,041   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-12-18T18:44:26,043   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-12-18T18:44:26,045   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-12-18T18:44:26,046   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-12-18T18:44:26,049   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-12-18T18:44:26,050   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-12-18T18:44:26,052   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-12-18T18:44:26,054   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-12-18T18:44:26,055   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-12-18T18:44:26,058   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-12-18T18:44:26,060   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-12-18T18:44:26,061   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-12-18T18:44:26,063   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-12-18T18:44:26,065   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-12-18T18:44:26,067   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-12-18T18:44:26,069   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-12-18T18:44:26,070   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-12-18T18:44:26,072   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-12-18T18:44:26,073   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-12-18T18:44:26,074   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-12-18T18:44:26,076   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-12-18T18:44:26,078   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-12-18T18:44:26,080   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-12-18T18:44:26,082   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-12-18T18:44:26,085   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-12-18T18:44:26,086   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-12-18T18:44:26,088   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-12-18T18:44:26,090   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-12-18T18:44:26,092   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-12-18T18:44:26,094   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-12-18T18:44:26,095   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-12-18T18:44:26,096   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-12-18T18:44:26,098   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-12-18T18:44:26,100   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-12-18T18:44:26,102   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-12-18T18:44:26,104   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-12-18T18:44:26,106   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-12-18T18:44:26,108   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-12-18T18:44:26,112   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-12-18T18:44:26,115   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-12-18T18:44:26,117   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-12-18T18:44:26,121   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-12-18T18:44:26,124   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-12-18T18:44:26,127   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-12-18T18:44:26,129   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-12-18T18:44:26,131   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-12-18T18:44:26,134   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-12-18T18:44:26,136   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-12-18T18:44:26,137   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-12-18T18:44:26,143   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-12-18T18:44:26,144   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-12-18T18:44:26,146   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-12-18T18:44:26,149   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-12-18T18:44:26,151   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-12-18T18:44:26,154   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-12-18T18:44:26,156   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-12-18T18:44:26,158   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-12-18T18:44:26,160   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-12-18T18:44:26,162   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-12-18T18:44:26,164   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-12-18T18:44:26,165   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-12-18T18:44:26,167   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-12-18T18:44:26,169   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-12-18T18:44:26,171   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-12-18T18:44:26,172   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-12-18T18:44:26,173   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-12-18T18:44:26,175   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-12-18T18:44:26,176   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-12-18T18:44:26,178   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-12-18T18:44:26,180   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-12-18T18:44:26,181   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-12-18T18:44:26,183   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-12-18T18:44:26,184   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-12-18T18:44:26,186   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-12-18T18:44:26,187   adding 'deepspeed/ops/gds/__init__.py'
2024-12-18T18:44:26,189   adding 'deepspeed/ops/lamb/__init__.py'
2024-12-18T18:44:26,190   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-12-18T18:44:26,192   adding 'deepspeed/ops/lion/__init__.py'
2024-12-18T18:44:26,193   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-12-18T18:44:26,195   adding 'deepspeed/ops/lion/fused_lion.py'
2024-12-18T18:44:26,196   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-12-18T18:44:26,198   adding 'deepspeed/ops/op_builder/__init__.py'
2024-12-18T18:44:26,199   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-12-18T18:44:26,201   adding 'deepspeed/ops/op_builder/async_io.py'
2024-12-18T18:44:26,205   adding 'deepspeed/ops/op_builder/builder.py'
2024-12-18T18:44:26,207   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-12-18T18:44:26,208   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-12-18T18:44:26,209   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-12-18T18:44:26,211   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-12-18T18:44:26,212   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-12-18T18:44:26,213   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-12-18T18:44:26,215   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-12-18T18:44:26,216   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-12-18T18:44:26,217   adding 'deepspeed/ops/op_builder/gds.py'
2024-12-18T18:44:26,218   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-12-18T18:44:26,220   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-12-18T18:44:26,221   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-12-18T18:44:26,222   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-12-18T18:44:26,224   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-12-18T18:44:26,225   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-12-18T18:44:26,226   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-12-18T18:44:26,228   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-12-18T18:44:26,229   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-12-18T18:44:26,230   adding 'deepspeed/ops/op_builder/transformer.py'
2024-12-18T18:44:26,231   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-12-18T18:44:26,233   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-12-18T18:44:26,235   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2024-12-18T18:44:26,236   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-12-18T18:44:26,237   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-12-18T18:44:26,238   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-12-18T18:44:26,240   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-12-18T18:44:26,241   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-12-18T18:44:26,243   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-12-18T18:44:26,244   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-12-18T18:44:26,245   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-12-18T18:44:26,246   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-12-18T18:44:26,247   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-12-18T18:44:26,249   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2024-12-18T18:44:26,250   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2024-12-18T18:44:26,251   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2024-12-18T18:44:26,252   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2024-12-18T18:44:26,253   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2024-12-18T18:44:26,255   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2024-12-18T18:44:26,256   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2024-12-18T18:44:26,258   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-12-18T18:44:26,259   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-12-18T18:44:26,260   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-12-18T18:44:26,261   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-12-18T18:44:26,262   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-12-18T18:44:26,264   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-12-18T18:44:26,265   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-12-18T18:44:26,267   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-12-18T18:44:26,268   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-12-18T18:44:26,270   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-12-18T18:44:26,271   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-12-18T18:44:26,273   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-12-18T18:44:26,274   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-12-18T18:44:26,275   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-12-18T18:44:26,276   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-12-18T18:44:26,277   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-12-18T18:44:26,278   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-12-18T18:44:26,280   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-12-18T18:44:26,281   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-12-18T18:44:26,283   adding 'deepspeed/ops/quantizer/__init__.py'
2024-12-18T18:44:26,284   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-12-18T18:44:26,286   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-12-18T18:44:26,287   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-12-18T18:44:26,289   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-12-18T18:44:26,290   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-12-18T18:44:26,294   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-12-18T18:44:26,296   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-12-18T18:44:26,298   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-12-18T18:44:26,300   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-12-18T18:44:26,305   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-12-18T18:44:26,306   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-12-18T18:44:26,308   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-12-18T18:44:26,309   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-12-18T18:44:26,311   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-12-18T18:44:26,312   adding 'deepspeed/ops/transformer/__init__.py'
2024-12-18T18:44:26,315   adding 'deepspeed/ops/transformer/transformer.py'
2024-12-18T18:44:26,317   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-12-18T18:44:26,318   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-12-18T18:44:26,320   adding 'deepspeed/ops/transformer/inference/config.py'
2024-12-18T18:44:26,321   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-12-18T18:44:26,323   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-12-18T18:44:26,324   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-12-18T18:44:26,326   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-12-18T18:44:26,328   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-12-18T18:44:26,330   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-12-18T18:44:26,332   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-12-18T18:44:26,338   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-12-18T18:44:26,339   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-12-18T18:44:26,340   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2024-12-18T18:44:26,341   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2024-12-18T18:44:26,343   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2024-12-18T18:44:26,344   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2024-12-18T18:44:26,345   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2024-12-18T18:44:26,346   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2024-12-18T18:44:26,348   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-12-18T18:44:26,349   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2024-12-18T18:44:26,350   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-12-18T18:44:26,352   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-12-18T18:44:26,353   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2024-12-18T18:44:26,354   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2024-12-18T18:44:26,355   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2024-12-18T18:44:26,357   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-12-18T18:44:26,358   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-12-18T18:44:26,360   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2024-12-18T18:44:26,361   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-12-18T18:44:26,363   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-12-18T18:44:26,364   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2024-12-18T18:44:26,365   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-12-18T18:44:26,367   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2024-12-18T18:44:26,369   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-12-18T18:44:26,371   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-12-18T18:44:26,372   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-12-18T18:44:26,374   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-12-18T18:44:26,376   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-12-18T18:44:26,378   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-12-18T18:44:26,379   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-12-18T18:44:26,380   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-12-18T18:44:26,381   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-12-18T18:44:26,383   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-12-18T18:44:26,385   adding 'deepspeed/pipe/__init__.py'
2024-12-18T18:44:26,387   adding 'deepspeed/profiling/__init__.py'
2024-12-18T18:44:26,388   adding 'deepspeed/profiling/config.py'
2024-12-18T18:44:26,389   adding 'deepspeed/profiling/constants.py'
2024-12-18T18:44:26,391   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-12-18T18:44:26,396   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-12-18T18:44:26,399   adding 'deepspeed/runtime/__init__.py'
2024-12-18T18:44:26,400   adding 'deepspeed/runtime/base_optimizer.py'
2024-12-18T18:44:26,403   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-12-18T18:44:26,404   adding 'deepspeed/runtime/compiler.py'
2024-12-18T18:44:26,408   adding 'deepspeed/runtime/config.py'
2024-12-18T18:44:26,410   adding 'deepspeed/runtime/config_utils.py'
2024-12-18T18:44:26,412   adding 'deepspeed/runtime/constants.py'
2024-12-18T18:44:26,414   adding 'deepspeed/runtime/dataloader.py'
2024-12-18T18:44:26,415   adding 'deepspeed/runtime/eigenvalue.py'
2024-12-18T18:44:26,434   adding 'deepspeed/runtime/engine.py'
2024-12-18T18:44:26,437   adding 'deepspeed/runtime/hybrid_engine.py'
2024-12-18T18:44:26,441   adding 'deepspeed/runtime/lr_schedules.py'
2024-12-18T18:44:26,443   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-12-18T18:44:26,444   adding 'deepspeed/runtime/quantize.py'
2024-12-18T18:44:26,445   adding 'deepspeed/runtime/sparse_tensor.py'
2024-12-18T18:44:26,448   adding 'deepspeed/runtime/state_dict_factory.py'
2024-12-18T18:44:26,453   adding 'deepspeed/runtime/utils.py'
2024-12-18T18:44:26,455   adding 'deepspeed/runtime/weight_quantizer.py'
2024-12-18T18:44:26,456   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-12-18T18:44:26,461   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-12-18T18:44:26,462   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-12-18T18:44:26,464   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-12-18T18:44:26,465   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-12-18T18:44:26,466   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-12-18T18:44:26,468   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-12-18T18:44:26,469   adding 'deepspeed/runtime/comm/__init__.py'
2024-12-18T18:44:26,471   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-12-18T18:44:26,473   adding 'deepspeed/runtime/comm/compressed.py'
2024-12-18T18:44:26,474   adding 'deepspeed/runtime/comm/hccl.py'
2024-12-18T18:44:26,476   adding 'deepspeed/runtime/comm/mpi.py'
2024-12-18T18:44:26,477   adding 'deepspeed/runtime/comm/nccl.py'
2024-12-18T18:44:26,479   adding 'deepspeed/runtime/compression/__init__.py'
2024-12-18T18:44:26,480   adding 'deepspeed/runtime/compression/cupy.py'
2024-12-18T18:44:26,482   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-12-18T18:44:26,483   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-12-18T18:44:26,485   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-12-18T18:44:26,486   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-12-18T18:44:26,488   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-12-18T18:44:26,490   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-12-18T18:44:26,491   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-12-18T18:44:26,492   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-12-18T18:44:26,493   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-12-18T18:44:26,495   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-12-18T18:44:26,500   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-12-18T18:44:26,503   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-12-18T18:44:26,506   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-12-18T18:44:26,507   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-12-18T18:44:26,509   adding 'deepspeed/runtime/domino/__init__.py'
2024-12-18T18:44:26,511   adding 'deepspeed/runtime/domino/transformer.py'
2024-12-18T18:44:26,513   adding 'deepspeed/runtime/fp16/__init__.py'
2024-12-18T18:44:26,516   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-12-18T18:44:26,518   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-12-18T18:44:26,520   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-12-18T18:44:26,522   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-12-18T18:44:26,524   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-12-18T18:44:26,527   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-12-18T18:44:26,529   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-12-18T18:44:26,531   adding 'deepspeed/runtime/pipe/__init__.py'
2024-12-18T18:44:26,538   adding 'deepspeed/runtime/pipe/engine.py'
2024-12-18T18:44:26,542   adding 'deepspeed/runtime/pipe/module.py'
2024-12-18T18:44:26,543   adding 'deepspeed/runtime/pipe/p2p.py'
2024-12-18T18:44:26,545   adding 'deepspeed/runtime/pipe/schedule.py'
2024-12-18T18:44:26,548   adding 'deepspeed/runtime/pipe/topology.py'
2024-12-18T18:44:26,550   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-12-18T18:44:26,551   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-12-18T18:44:26,552   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-12-18T18:44:26,553   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-12-18T18:44:26,556   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-12-18T18:44:26,558   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-12-18T18:44:26,560   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-12-18T18:44:26,562   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-12-18T18:44:26,564   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-12-18T18:44:26,566   adding 'deepspeed/runtime/zero/__init__.py'
2024-12-18T18:44:26,568   adding 'deepspeed/runtime/zero/config.py'
2024-12-18T18:44:26,570   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-12-18T18:44:26,572   adding 'deepspeed/runtime/zero/linear.py'
2024-12-18T18:44:26,574   adding 'deepspeed/runtime/zero/mics.py'
2024-12-18T18:44:26,576   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-12-18T18:44:26,578   adding 'deepspeed/runtime/zero/offload_config.py'
2024-12-18T18:44:26,579   adding 'deepspeed/runtime/zero/offload_states.py'
2024-12-18T18:44:26,582   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-12-18T18:44:26,593   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-12-18T18:44:26,597   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-12-18T18:44:26,598   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-12-18T18:44:26,615   adding 'deepspeed/runtime/zero/stage3.py'
2024-12-18T18:44:26,629   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-12-18T18:44:26,631   adding 'deepspeed/runtime/zero/test.py'
2024-12-18T18:44:26,633   adding 'deepspeed/runtime/zero/tiling.py'
2024-12-18T18:44:26,634   adding 'deepspeed/runtime/zero/utils.py'
2024-12-18T18:44:26,636   adding 'deepspeed/sequence/__init__.py'
2024-12-18T18:44:26,637   adding 'deepspeed/sequence/cross_entropy.py'
2024-12-18T18:44:26,642   adding 'deepspeed/sequence/fpdt_layer.py'
2024-12-18T18:44:26,644   adding 'deepspeed/sequence/layer.py'
2024-12-18T18:44:26,646   adding 'deepspeed/utils/__init__.py'
2024-12-18T18:44:26,647   adding 'deepspeed/utils/bwc.py'
2024-12-18T18:44:26,649   adding 'deepspeed/utils/comms_logging.py'
2024-12-18T18:44:26,650   adding 'deepspeed/utils/config.py'
2024-12-18T18:44:26,652   adding 'deepspeed/utils/debug.py'
2024-12-18T18:44:26,653   adding 'deepspeed/utils/exceptions.py'
2024-12-18T18:44:26,656   adding 'deepspeed/utils/groups.py'
2024-12-18T18:44:26,657   adding 'deepspeed/utils/init_on_device.py'
2024-12-18T18:44:26,659   adding 'deepspeed/utils/logging.py'
2024-12-18T18:44:26,660   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-12-18T18:44:26,662   adding 'deepspeed/utils/numa.py'
2024-12-18T18:44:26,663   adding 'deepspeed/utils/nvtx.py'
2024-12-18T18:44:26,665   adding 'deepspeed/utils/tensor_fragment.py'
2024-12-18T18:44:26,667   adding 'deepspeed/utils/timer.py'
2024-12-18T18:44:26,668   adding 'deepspeed/utils/torch.py'
2024-12-18T18:44:26,669   adding 'deepspeed/utils/types.py'
2024-12-18T18:44:26,671   adding 'deepspeed/utils/z3_leaf_module.py'
2024-12-18T18:44:26,675   adding 'deepspeed/utils/zero_to_fp32.py'
2024-12-18T18:44:26,677   adding 'deepspeed-0.16.2.data/scripts/deepspeed'
2024-12-18T18:44:26,678   adding 'deepspeed-0.16.2.data/scripts/deepspeed.pt'
2024-12-18T18:44:26,679   adding 'deepspeed-0.16.2.data/scripts/ds'
2024-12-18T18:44:26,680   adding 'deepspeed-0.16.2.data/scripts/ds_bench'
2024-12-18T18:44:26,681   adding 'deepspeed-0.16.2.data/scripts/ds_elastic'
2024-12-18T18:44:26,682   adding 'deepspeed-0.16.2.data/scripts/ds_io'
2024-12-18T18:44:26,683   adding 'deepspeed-0.16.2.data/scripts/ds_nvme_tune'
2024-12-18T18:44:26,684   adding 'deepspeed-0.16.2.data/scripts/ds_report'
2024-12-18T18:44:26,685   adding 'deepspeed-0.16.2.data/scripts/ds_ssh'
2024-12-18T18:44:26,686   adding 'deepspeed-0.16.2.data/scripts/dsr'
2024-12-18T18:44:26,689   adding 'deepspeed-0.16.2.dist-info/LICENSE'
2024-12-18T18:44:26,694   adding 'deepspeed-0.16.2.dist-info/METADATA'
2024-12-18T18:44:26,695   adding 'deepspeed-0.16.2.dist-info/WHEEL'
2024-12-18T18:44:26,696   adding 'deepspeed-0.16.2.dist-info/entry_points.txt'
2024-12-18T18:44:26,697   adding 'deepspeed-0.16.2.dist-info/top_level.txt'
2024-12-18T18:44:26,711   adding 'deepspeed-0.16.2.dist-info/RECORD'
2024-12-18T18:44:26,739   removing build/bdist.linux-armv7l/wheel
2024-12-18T18:44:26,963   deepspeed build time = 11.933043718338013 secs
2024-12-18T18:44:27,089   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-12-18T18:44:27,107   Created wheel for deepspeed: filename=deepspeed-0.16.2-py3-none-any.whl size=1547893 sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73
2024-12-18T18:44:27,108   Stored in directory: /tmp/pip-ephem-wheel-cache-eucz1x0z/wheels/83/22/b3/5885e393cf99d28112456a9744bbbfa3a30f47384a3eb03f49
2024-12-18T18:44:27,152 Successfully built deepspeed
2024-12-18T18:44:27,197 Removed build tracker: '/tmp/pip-build-tracker-9eo4bgxn'