2025-03-28T19:30:27,185 Created temporary directory: /tmp/pip-build-tracker-7ql5nv8v 2025-03-28T19:30:27,186 Initialized build tracking at /tmp/pip-build-tracker-7ql5nv8v 2025-03-28T19:30:27,186 Created build tracker: /tmp/pip-build-tracker-7ql5nv8v 2025-03-28T19:30:27,187 Entered build tracker: /tmp/pip-build-tracker-7ql5nv8v 2025-03-28T19:30:27,188 Created temporary directory: /tmp/pip-wheel-1d4zui7r 2025-03-28T19:30:27,191 Created temporary directory: /tmp/pip-ephem-wheel-cache-tazga4tz 2025-03-28T19:30:27,238 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-03-28T19:30:27,241 2 location(s) to search for versions of deepspeed: 2025-03-28T19:30:27,241 * https://pypi.org/simple/deepspeed/ 2025-03-28T19:30:27,241 * https://www.piwheels.org/simple/deepspeed/ 2025-03-28T19:30:27,242 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2025-03-28T19:30:27,243 Getting page https://pypi.org/simple/deepspeed/ 2025-03-28T19:30:27,244 Found index url https://pypi.org/simple/ 2025-03-28T19:30:27,391 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2025-03-28T19:30:27,412 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,413 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2025-03-28T19:30:27,413 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,414 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2025-03-28T19:30:27,415 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,415 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2025-03-28T19:30:27,416 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,417 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2025-03-28T19:30:27,417 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,418 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2025-03-28T19:30:27,419 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2025-03-28T19:30:27,419 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2025-03-28T19:30:27,422 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2025-03-28T19:30:27,423 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2025-03-28T19:30:27,423 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2025-03-28T19:30:27,424 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2025-03-28T19:30:27,424 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2025-03-28T19:30:27,425 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2025-03-28T19:30:27,425 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2025-03-28T19:30:27,426 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2025-03-28T19:30:27,427 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2025-03-28T19:30:27,427 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2025-03-28T19:30:27,428 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2025-03-28T19:30:27,429 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2025-03-28T19:30:27,429 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2025-03-28T19:30:27,430 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2025-03-28T19:30:27,431 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2025-03-28T19:30:27,432 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2025-03-28T19:30:27,432 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2025-03-28T19:30:27,433 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2025-03-28T19:30:27,434 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2025-03-28T19:30:27,435 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2025-03-28T19:30:27,435 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2025-03-28T19:30:27,436 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2025-03-28T19:30:27,437 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2025-03-28T19:30:27,437 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2025-03-28T19:30:27,438 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2025-03-28T19:30:27,438 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2025-03-28T19:30:27,439 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2025-03-28T19:30:27,440 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2025-03-28T19:30:27,440 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2025-03-28T19:30:27,441 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2025-03-28T19:30:27,441 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2025-03-28T19:30:27,442 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2025-03-28T19:30:27,443 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2025-03-28T19:30:27,443 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2025-03-28T19:30:27,444 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2025-03-28T19:30:27,445 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2025-03-28T19:30:27,445 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2025-03-28T19:30:27,446 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2025-03-28T19:30:27,447 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2025-03-28T19:30:27,448 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2025-03-28T19:30:27,448 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2025-03-28T19:30:27,449 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2025-03-28T19:30:27,449 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2025-03-28T19:30:27,450 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2025-03-28T19:30:27,451 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2025-03-28T19:30:27,451 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2025-03-28T19:30:27,452 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2025-03-28T19:30:27,452 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2025-03-28T19:30:27,453 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2025-03-28T19:30:27,454 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2025-03-28T19:30:27,454 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2025-03-28T19:30:27,455 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2025-03-28T19:30:27,456 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2025-03-28T19:30:27,456 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2025-03-28T19:30:27,457 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2025-03-28T19:30:27,458 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2025-03-28T19:30:27,459 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2025-03-28T19:30:27,459 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2025-03-28T19:30:27,460 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2025-03-28T19:30:27,460 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2025-03-28T19:30:27,461 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2025-03-28T19:30:27,461 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2025-03-28T19:30:27,462 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2025-03-28T19:30:27,463 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2025-03-28T19:30:27,463 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2025-03-28T19:30:27,464 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2025-03-28T19:30:27,465 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2025-03-28T19:30:27,465 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2025-03-28T19:30:27,466 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2025-03-28T19:30:27,467 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2025-03-28T19:30:27,468 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2025-03-28T19:30:27,468 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2025-03-28T19:30:27,469 Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6 2025-03-28T19:30:27,470 Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0 2025-03-28T19:30:27,470 Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1 2025-03-28T19:30:27,471 Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2 2025-03-28T19:30:27,472 Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3 2025-03-28T19:30:27,472 Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4 2025-03-28T19:30:27,473 Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5 2025-03-28T19:30:27,473 Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0 2025-03-28T19:30:27,474 Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1 2025-03-28T19:30:27,475 Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2 2025-03-28T19:30:27,475 Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3 2025-03-28T19:30:27,476 Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4 2025-03-28T19:30:27,476 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,477 Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5 2025-03-28T19:30:27,478 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,478 Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0 2025-03-28T19:30:27,479 Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1 2025-03-28T19:30:27,480 Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2 2025-03-28T19:30:27,480 Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3 2025-03-28T19:30:27,481 Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4 2025-03-28T19:30:27,482 Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0 2025-03-28T19:30:27,482 Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1 2025-03-28T19:30:27,483 Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2 2025-03-28T19:30:27,484 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,485 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,485 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,485 Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3 2025-03-28T19:30:27,486 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,487 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,487 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,488 Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4 2025-03-28T19:30:27,488 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,489 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,490 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-03-28T19:30:27,490 Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5 2025-03-28T19:30:27,491 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2025-03-28T19:30:27,492 Getting page https://www.piwheels.org/simple/deepspeed/ 2025-03-28T19:30:27,493 Found index url https://www.piwheels.org/simple/ 2025-03-28T19:30:27,666 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2025-03-28T19:30:27,685 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.4-py3-none-any.whl#sha256=f7e7f46731a9413aa0993e9ee9416b6a9855dffe584e16f0bbd4194a018748b2 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,686 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.3-py3-none-any.whl#sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,686 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,687 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,687 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,688 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,689 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,689 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,690 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,690 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,691 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,691 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,692 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,692 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,693 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,694 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,694 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,695 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,695 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,696 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,696 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,697 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,697 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,698 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,699 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,699 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,700 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,700 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,701 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,702 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,702 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,703 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,703 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,704 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,704 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,705 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,705 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,706 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,706 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,707 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,707 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,708 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,709 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,709 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,710 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,711 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,711 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,712 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,712 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,713 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,713 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,714 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,714 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,714 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,715 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,715 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,716 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,717 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,717 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,718 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,718 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,719 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,719 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,719 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,720 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,720 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,721 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,721 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,722 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,723 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,723 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,724 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,724 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,725 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,725 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,726 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,726 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2025-03-28T19:30:27,727 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2025-03-28T19:30:27,727 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2025-03-28T19:30:27,759 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2025-03-28T19:30:27,762 Collecting deepspeed==0.16.5 2025-03-28T19:30:27,764 Created temporary directory: /tmp/pip-unpack-1_bsnmpw 2025-03-28T19:30:27,904 Downloading deepspeed-0.16.5.tar.gz (1.5 MB) 2025-03-28T19:30:30,407 Added deepspeed==0.16.5 from https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz to build tracker '/tmp/pip-build-tracker-7ql5nv8v' 2025-03-28T19:30:30,410 Running setup.py (path:/tmp/pip-wheel-1d4zui7r/deepspeed_2447773a07194a3e846c763f626e2391/setup.py) egg_info for package deepspeed 2025-03-28T19:30:30,410 Created temporary directory: /tmp/pip-pip-egg-info-h6_fh6vr 2025-03-28T19:30:30,411 Preparing metadata (setup.py): started 2025-03-28T19:30:30,412 Running command python setup.py egg_info 2025-03-28T19:30:31,480 fatal: not a git repository (or any of the parent directories): .git 2025-03-28T19:30:32,376 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-03-28T19:30:32,376  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-03-28T19:30:32,377 DS_BUILD_OPS=0 2025-03-28T19:30:32,378 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-03-28T19:30:32,378 version=0.16.5, git_hash=unknown, git_branch=unknown 2025-03-28T19:30:32,379 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-03-28T19:30:32,379 ext_modules=[] 2025-03-28T19:30:32,380 running egg_info 2025-03-28T19:30:32,404 creating /tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info 2025-03-28T19:30:32,405 writing /tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info/PKG-INFO 2025-03-28T19:30:32,440 writing dependency_links to /tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info/dependency_links.txt 2025-03-28T19:30:32,442 writing entry points to /tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info/entry_points.txt 2025-03-28T19:30:32,459 writing requirements to /tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info/requires.txt 2025-03-28T19:30:32,461 writing top-level names to /tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info/top_level.txt 2025-03-28T19:30:32,462 writing manifest file '/tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info/SOURCES.txt' 2025-03-28T19:30:32,713 reading manifest file '/tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info/SOURCES.txt' 2025-03-28T19:30:32,715 reading manifest template 'MANIFEST.in' 2025-03-28T19:30:32,717 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-03-28T19:30:32,718 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-03-28T19:30:34,522 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-03-28T19:30:35,565 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-03-28T19:30:36,284 warning: no files found matching '*.tr' under directory 'csrc' 2025-03-28T19:30:36,446 warning: no files found matching '*.cc' under directory 'csrc' 2025-03-28T19:30:36,496 warning: no files found matching '*.py' under directory 'benchmarks' 2025-03-28T19:30:36,503 adding license file 'LICENSE' 2025-03-28T19:30:36,542 writing manifest file '/tmp/pip-pip-egg-info-h6_fh6vr/deepspeed.egg-info/SOURCES.txt' 2025-03-28T19:30:36,545 deepspeed build time = 5.061819076538086 secs 2025-03-28T19:30:36,667 Preparing metadata (setup.py): finished with status 'done' 2025-03-28T19:30:36,674 Source in /tmp/pip-wheel-1d4zui7r/deepspeed_2447773a07194a3e846c763f626e2391 has version 0.16.5, which satisfies requirement deepspeed==0.16.5 from https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz 2025-03-28T19:30:36,675 Removed deepspeed==0.16.5 from https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz from build tracker '/tmp/pip-build-tracker-7ql5nv8v' 2025-03-28T19:30:36,748 Created temporary directory: /tmp/pip-unpack-7gwnk44y 2025-03-28T19:30:36,749 Created temporary directory: /tmp/pip-unpack-l8hfyv_j 2025-03-28T19:30:36,749 Building wheels for collected packages: deepspeed 2025-03-28T19:30:36,753 Created temporary directory: /tmp/pip-wheel-5y0j1qq1 2025-03-28T19:30:36,754 Building wheel for deepspeed (setup.py): started 2025-03-28T19:30:36,755 Destination directory: /tmp/pip-wheel-5y0j1qq1 2025-03-28T19:30:36,756 Running command python setup.py bdist_wheel 2025-03-28T19:30:37,267 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-03-28T19:30:37,272  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-03-28T19:30:37,412 DS_BUILD_OPS=0 2025-03-28T19:30:37,530 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-03-28T19:30:37,550 fatal: not a git repository (or any of the parent directories): .git 2025-03-28T19:30:37,551 version=0.16.5, git_hash=unknown, git_branch=unknown 2025-03-28T19:30:37,552 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-03-28T19:30:37,553 ext_modules=[] 2025-03-28T19:30:39,943 running bdist_wheel 2025-03-28T19:30:40,082 running build 2025-03-28T19:30:40,082 running build_py 2025-03-28T19:30:40,114 creating build/lib/deepspeed 2025-03-28T19:30:40,117 copying deepspeed/env_report.py -> build/lib/deepspeed 2025-03-28T19:30:40,120 copying deepspeed/constants.py -> build/lib/deepspeed 2025-03-28T19:30:40,122 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2025-03-28T19:30:40,124 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2025-03-28T19:30:40,126 copying deepspeed/__init__.py -> build/lib/deepspeed 2025-03-28T19:30:40,130 creating build/lib/deepspeed/launcher 2025-03-28T19:30:40,131 copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher 2025-03-28T19:30:40,133 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2025-03-28T19:30:40,136 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2025-03-28T19:30:40,139 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2025-03-28T19:30:40,142 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2025-03-28T19:30:40,144 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2025-03-28T19:30:40,146 creating build/lib/deepspeed/model_implementations 2025-03-28T19:30:40,147 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2025-03-28T19:30:40,150 creating build/lib/deepspeed/elasticity 2025-03-28T19:30:40,151 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2025-03-28T19:30:40,154 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2025-03-28T19:30:40,156 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2025-03-28T19:30:40,158 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2025-03-28T19:30:40,160 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2025-03-28T19:30:40,162 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2025-03-28T19:30:40,165 creating build/lib/deepspeed/inference 2025-03-28T19:30:40,167 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2025-03-28T19:30:40,170 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2025-03-28T19:30:40,172 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2025-03-28T19:30:40,175 creating build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,176 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,178 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,181 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,184 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,186 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,189 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,191 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,193 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,195 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,197 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2025-03-28T19:30:40,200 creating build/lib/deepspeed/runtime 2025-03-28T19:30:40,202 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,204 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,207 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,209 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,212 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,214 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,220 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,222 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,225 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,228 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,230 copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,233 copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,235 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,237 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,241 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,245 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,248 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,250 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2025-03-28T19:30:40,253 creating build/lib/deepspeed/nebula 2025-03-28T19:30:40,254 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2025-03-28T19:30:40,256 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2025-03-28T19:30:40,258 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2025-03-28T19:30:40,261 creating build/lib/deepspeed/linear 2025-03-28T19:30:40,262 copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear 2025-03-28T19:30:40,265 copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear 2025-03-28T19:30:40,267 copying deepspeed/linear/config.py -> build/lib/deepspeed/linear 2025-03-28T19:30:40,270 copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear 2025-03-28T19:30:40,272 copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear 2025-03-28T19:30:40,275 creating build/lib/deepspeed/nvme 2025-03-28T19:30:40,276 copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,278 copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,281 copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,284 copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,285 copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,288 copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,290 copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,292 copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,294 copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,296 copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,298 copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,301 copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme 2025-03-28T19:30:40,303 creating build/lib/deepspeed/autotuning 2025-03-28T19:30:40,305 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2025-03-28T19:30:40,308 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2025-03-28T19:30:40,312 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2025-03-28T19:30:40,314 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2025-03-28T19:30:40,316 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2025-03-28T19:30:40,321 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2025-03-28T19:30:40,324 creating build/lib/deepspeed/compression 2025-03-28T19:30:40,326 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2025-03-28T19:30:40,329 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2025-03-28T19:30:40,332 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2025-03-28T19:30:40,337 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2025-03-28T19:30:40,339 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2025-03-28T19:30:40,342 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2025-03-28T19:30:40,346 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2025-03-28T19:30:40,349 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2025-03-28T19:30:40,357 creating build/lib/deepspeed/profiling 2025-03-28T19:30:40,361 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2025-03-28T19:30:40,365 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2025-03-28T19:30:40,367 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2025-03-28T19:30:40,371 creating build/lib/deepspeed/utils 2025-03-28T19:30:40,374 copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,379 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,385 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,388 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,391 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,393 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,395 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,398 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,401 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,404 copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,407 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,410 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,412 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,415 copying deepspeed/utils/config.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,418 copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,421 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,425 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,432 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2025-03-28T19:30:40,436 creating build/lib/deepspeed/ops 2025-03-28T19:30:40,437 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2025-03-28T19:30:40,442 creating build/lib/deepspeed/sequence 2025-03-28T19:30:40,444 copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence 2025-03-28T19:30:40,456 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2025-03-28T19:30:40,464 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2025-03-28T19:30:40,466 copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence 2025-03-28T19:30:40,470 creating build/lib/deepspeed/moe 2025-03-28T19:30:40,472 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2025-03-28T19:30:40,474 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2025-03-28T19:30:40,476 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2025-03-28T19:30:40,479 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2025-03-28T19:30:40,483 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2025-03-28T19:30:40,485 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2025-03-28T19:30:40,488 creating build/lib/deepspeed/pipe 2025-03-28T19:30:40,489 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2025-03-28T19:30:40,492 creating build/lib/deepspeed/accelerator 2025-03-28T19:30:40,494 copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,497 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,501 copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,504 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,507 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,509 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,512 copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,515 copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,518 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,520 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,522 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-03-28T19:30:40,525 creating build/lib/deepspeed/monitor 2025-03-28T19:30:40,526 copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor 2025-03-28T19:30:40,528 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2025-03-28T19:30:40,530 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2025-03-28T19:30:40,532 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2025-03-28T19:30:40,534 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2025-03-28T19:30:40,536 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2025-03-28T19:30:40,538 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2025-03-28T19:30:40,540 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2025-03-28T19:30:40,542 creating build/lib/deepspeed/comm 2025-03-28T19:30:40,544 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,546 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,549 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,551 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,553 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,555 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,557 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,559 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,561 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2025-03-28T19:30:40,565 creating build/lib/deepspeed/module_inject 2025-03-28T19:30:40,566 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,569 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,571 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,576 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,578 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,581 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,583 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,586 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,588 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,591 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,593 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,596 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,598 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2025-03-28T19:30:40,601 creating build/lib/deepspeed/model_implementations/features 2025-03-28T19:30:40,602 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2025-03-28T19:30:40,605 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2025-03-28T19:30:40,608 creating build/lib/deepspeed/model_implementations/diffusers 2025-03-28T19:30:40,609 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2025-03-28T19:30:40,612 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2025-03-28T19:30:40,613 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2025-03-28T19:30:40,616 creating build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,617 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,619 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,621 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,623 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,625 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,627 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,629 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,631 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,633 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,636 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2025-03-28T19:30:40,638 creating build/lib/deepspeed/inference/quantization 2025-03-28T19:30:40,640 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2025-03-28T19:30:40,642 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2025-03-28T19:30:40,644 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2025-03-28T19:30:40,648 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2025-03-28T19:30:40,650 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2025-03-28T19:30:40,653 creating build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,654 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,657 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,659 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,661 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,664 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,667 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,671 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,673 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,675 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2025-03-28T19:30:40,678 creating build/lib/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:40,680 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:40,685 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:40,688 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:40,690 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:40,693 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:40,696 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:40,697 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:40,701 creating build/lib/deepspeed/inference/v2/checkpoint 2025-03-28T19:30:40,702 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-03-28T19:30:40,705 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-03-28T19:30:40,707 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-03-28T19:30:40,709 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-03-28T19:30:40,712 creating build/lib/deepspeed/inference/v2/ragged 2025-03-28T19:30:40,713 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2025-03-28T19:30:40,718 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2025-03-28T19:30:40,722 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2025-03-28T19:30:40,725 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2025-03-28T19:30:40,727 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2025-03-28T19:30:40,730 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2025-03-28T19:30:40,733 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2025-03-28T19:30:40,736 creating build/lib/deepspeed/inference/v2/kernels 2025-03-28T19:30:40,737 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2025-03-28T19:30:40,740 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2025-03-28T19:30:40,744 creating build/lib/deepspeed/inference/v2/modules 2025-03-28T19:30:40,747 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2025-03-28T19:30:40,750 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2025-03-28T19:30:40,753 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2025-03-28T19:30:40,756 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2025-03-28T19:30:40,760 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:40,761 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:40,764 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:40,766 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:40,769 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:40,772 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:40,773 copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:40,776 copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:40,779 copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:40,782 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:40,785 creating build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:40,786 copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:40,788 copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:40,791 copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:40,793 copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:40,796 creating build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:40,798 copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:40,801 copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:40,804 copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:40,806 copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:40,810 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,812 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,815 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,818 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,821 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,824 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,827 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,865 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,868 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,880 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:40,883 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:41,871 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:42,798 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:42,925 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:42,930 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:42,946 creating build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:42,949 copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:42,954 copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:42,960 copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:42,964 copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:42,969 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:42,971 copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:42,975 copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:42,980 copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:42,984 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:42,989 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:42,991 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:42,995 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:42,999 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:43,003 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:43,008 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,010 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,014 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,018 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,022 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,026 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,029 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,034 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,037 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,040 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:43,045 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:43,047 copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:43,053 copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:43,056 copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:43,058 copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:43,061 creating build/lib/deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:43,063 copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:43,067 copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:43,069 copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:43,072 copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:43,075 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-03-28T19:30:43,077 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-03-28T19:30:43,080 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2025-03-28T19:30:43,081 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-03-28T19:30:43,085 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-03-28T19:30:43,086 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-03-28T19:30:43,090 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:43,092 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:43,095 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:43,098 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:43,101 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:43,103 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:43,106 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:43,111 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:43,113 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:43,116 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:43,120 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:43,122 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:43,126 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:43,129 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:43,132 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:43,138 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:43,140 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:43,142 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:43,146 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:43,147 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:43,150 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:43,153 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:43,155 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:43,157 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:43,160 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:43,161 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:43,164 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:43,167 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:43,169 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:43,172 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:43,175 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:43,177 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:43,180 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:43,183 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:43,184 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:43,186 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:43,189 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:43,190 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:43,193 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:43,195 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:43,197 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:43,199 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:43,202 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:43,203 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:43,206 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:43,208 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:43,210 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:43,213 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:43,214 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:43,216 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:43,219 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:43,220 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:43,222 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:43,225 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:43,226 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:43,229 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:43,231 creating build/lib/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:43,233 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:43,235 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:43,237 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:43,240 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:43,242 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:43,245 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:43,247 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:43,250 creating build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,251 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,253 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,255 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,257 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,260 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,261 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,264 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,266 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:43,269 creating build/lib/deepspeed/inference/v2/modules/implementations 2025-03-28T19:30:43,270 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2025-03-28T19:30:43,273 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-03-28T19:30:43,274 copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-03-28T19:30:43,277 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-03-28T19:30:43,279 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-03-28T19:30:43,282 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-03-28T19:30:43,283 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-03-28T19:30:43,285 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-03-28T19:30:43,288 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-03-28T19:30:43,289 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-03-28T19:30:43,291 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-03-28T19:30:43,294 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-03-28T19:30:43,296 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-03-28T19:30:43,298 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-03-28T19:30:43,302 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-03-28T19:30:43,303 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-03-28T19:30:43,306 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-03-28T19:30:43,309 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-03-28T19:30:43,311 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-03-28T19:30:43,314 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-03-28T19:30:43,316 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-03-28T19:30:43,318 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-03-28T19:30:43,320 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-03-28T19:30:43,322 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-03-28T19:30:43,325 creating build/lib/deepspeed/runtime/domino 2025-03-28T19:30:43,326 copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino 2025-03-28T19:30:43,329 copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino 2025-03-28T19:30:43,331 creating build/lib/deepspeed/runtime/activation_checkpointing 2025-03-28T19:30:43,332 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-03-28T19:30:43,336 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-03-28T19:30:43,338 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-03-28T19:30:43,340 creating build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,342 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,345 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,350 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,353 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,357 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,360 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,364 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,366 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,369 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,372 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,375 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,378 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,381 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,384 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,387 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,389 copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,392 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2025-03-28T19:30:43,395 creating build/lib/deepspeed/runtime/compression 2025-03-28T19:30:43,396 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2025-03-28T19:30:43,398 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2025-03-28T19:30:43,401 creating build/lib/deepspeed/runtime/data_pipeline 2025-03-28T19:30:43,403 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2025-03-28T19:30:43,406 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2025-03-28T19:30:43,408 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2025-03-28T19:30:43,410 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2025-03-28T19:30:43,413 creating build/lib/deepspeed/runtime/fp16 2025-03-28T19:30:43,415 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2025-03-28T19:30:43,417 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-03-28T19:30:43,420 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-03-28T19:30:43,423 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2025-03-28T19:30:43,426 creating build/lib/deepspeed/runtime/pipe 2025-03-28T19:30:43,428 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2025-03-28T19:30:43,431 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2025-03-28T19:30:43,435 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2025-03-28T19:30:43,438 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2025-03-28T19:30:43,441 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2025-03-28T19:30:43,443 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2025-03-28T19:30:43,446 creating build/lib/deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:43,447 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:43,449 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:43,451 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:43,453 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:43,457 creating build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,458 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,462 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,466 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,469 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,473 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,475 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,478 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,482 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,484 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-03-28T19:30:43,488 creating build/lib/deepspeed/runtime/comm 2025-03-28T19:30:43,489 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2025-03-28T19:30:43,492 copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm 2025-03-28T19:30:43,494 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2025-03-28T19:30:43,498 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2025-03-28T19:30:43,501 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2025-03-28T19:30:43,503 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2025-03-28T19:30:43,506 creating build/lib/deepspeed/runtime/tensor_parallel 2025-03-28T19:30:43,508 copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-03-28T19:30:43,510 copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-03-28T19:30:43,512 copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-03-28T19:30:43,515 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:43,516 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:43,518 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:43,520 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:43,522 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:43,524 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:43,527 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:43,528 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:43,531 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:43,534 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:43,538 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:43,540 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:43,542 copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:43,546 creating build/lib/deepspeed/runtime/fp16/onebit 2025-03-28T19:30:43,548 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-03-28T19:30:43,551 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-03-28T19:30:43,554 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-03-28T19:30:43,556 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-03-28T19:30:43,559 creating build/lib/deepspeed/autotuning/tuner 2025-03-28T19:30:43,560 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2025-03-28T19:30:43,563 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-03-28T19:30:43,565 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-03-28T19:30:43,567 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2025-03-28T19:30:43,570 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-03-28T19:30:43,572 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2025-03-28T19:30:43,574 creating build/lib/deepspeed/profiling/flops_profiler 2025-03-28T19:30:43,576 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2025-03-28T19:30:43,578 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2025-03-28T19:30:43,582 creating build/lib/deepspeed/ops/deepspeed4science 2025-03-28T19:30:43,583 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2025-03-28T19:30:43,586 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2025-03-28T19:30:43,588 creating build/lib/deepspeed/ops/sparse_attention 2025-03-28T19:30:43,589 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2025-03-28T19:30:43,592 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2025-03-28T19:30:43,595 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-03-28T19:30:43,597 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2025-03-28T19:30:43,600 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-03-28T19:30:43,602 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2025-03-28T19:30:43,605 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2025-03-28T19:30:43,608 creating build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,609 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,614 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,616 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,618 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,620 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,622 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,624 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,626 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,628 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,630 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,633 copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,635 copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,637 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,639 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,641 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,643 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,646 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,648 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,650 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,653 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,654 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,656 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,659 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,662 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2025-03-28T19:30:43,665 creating build/lib/deepspeed/ops/quantizer 2025-03-28T19:30:43,667 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2025-03-28T19:30:43,669 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2025-03-28T19:30:43,672 creating build/lib/deepspeed/ops/aio 2025-03-28T19:30:43,673 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2025-03-28T19:30:43,675 creating build/lib/deepspeed/ops/adam 2025-03-28T19:30:43,678 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2025-03-28T19:30:43,680 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2025-03-28T19:30:43,682 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2025-03-28T19:30:43,685 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2025-03-28T19:30:43,689 creating build/lib/deepspeed/ops/fp_quantizer 2025-03-28T19:30:43,690 copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer 2025-03-28T19:30:43,694 copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer 2025-03-28T19:30:43,696 copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer 2025-03-28T19:30:43,699 copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer 2025-03-28T19:30:43,702 creating build/lib/deepspeed/ops/adagrad 2025-03-28T19:30:43,772 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2025-03-28T19:30:43,778 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2025-03-28T19:30:43,782 creating build/lib/deepspeed/ops/lamb 2025-03-28T19:30:43,784 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2025-03-28T19:30:43,787 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2025-03-28T19:30:43,791 creating build/lib/deepspeed/ops/gds 2025-03-28T19:30:43,793 copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds 2025-03-28T19:30:43,797 creating build/lib/deepspeed/ops/lion 2025-03-28T19:30:43,799 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2025-03-28T19:30:43,802 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2025-03-28T19:30:43,806 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2025-03-28T19:30:43,809 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2025-03-28T19:30:43,813 creating build/lib/deepspeed/ops/transformer 2025-03-28T19:30:43,814 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2025-03-28T19:30:43,819 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2025-03-28T19:30:43,822 creating build/lib/deepspeed/ops/random_ltd 2025-03-28T19:30:43,824 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2025-03-28T19:30:43,827 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2025-03-28T19:30:43,831 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:43,833 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:43,837 creating build/lib/deepspeed/ops/op_builder/mlu 2025-03-28T19:30:43,839 copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-03-28T19:30:43,842 copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-03-28T19:30:43,846 copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-03-28T19:30:43,849 copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-03-28T19:30:43,852 copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-03-28T19:30:43,855 copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-03-28T19:30:43,859 creating build/lib/deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:43,861 copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:43,865 copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:43,868 copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:43,871 copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:43,874 copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:43,877 creating build/lib/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:43,879 copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:43,882 copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:43,884 copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:43,887 copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:43,890 copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:43,892 copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:43,894 copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:43,897 creating build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,899 copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,902 copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,905 copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,907 copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,909 copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,911 copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,913 copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,915 copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,917 copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,920 copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:43,923 creating build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,924 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,927 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,930 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,932 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,934 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,936 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,938 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,941 copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,943 copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu 2025-03-28T19:30:43,946 creating build/lib/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:43,948 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:43,950 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:43,953 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:43,955 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:43,957 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:43,960 copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:43,962 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:43,967 creating build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,969 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,972 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,974 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,977 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,980 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,983 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,985 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,989 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,992 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,994 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2025-03-28T19:30:43,998 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:43,999 copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,002 copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,004 copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,007 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,010 copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,012 copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,015 copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,017 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,020 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,022 copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,025 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,028 copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,031 copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,034 copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,036 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,039 copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,041 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,044 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,047 copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,050 copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,052 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,054 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,057 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:44,061 creating build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,062 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,065 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,068 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,070 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,072 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,075 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,078 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,080 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,084 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,086 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:44,090 creating build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,091 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,094 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,097 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,100 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,103 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,105 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,108 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,111 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,113 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,116 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,119 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,122 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,124 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,128 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,130 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,132 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,134 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,137 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,140 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2025-03-28T19:30:44,143 creating build/lib/deepspeed/module_inject/containers/features 2025-03-28T19:30:44,145 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2025-03-28T19:30:44,148 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2025-03-28T19:30:44,152 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-03-28T19:30:44,154 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-03-28T19:30:44,157 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2025-03-28T19:30:44,160 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2025-03-28T19:30:44,162 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2025-03-28T19:30:44,165 running egg_info 2025-03-28T19:30:44,194 writing deepspeed.egg-info/PKG-INFO 2025-03-28T19:30:44,256 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2025-03-28T19:30:44,258 writing entry points to deepspeed.egg-info/entry_points.txt 2025-03-28T19:30:44,275 writing requirements to deepspeed.egg-info/requires.txt 2025-03-28T19:30:44,276 writing top-level names to deepspeed.egg-info/top_level.txt 2025-03-28T19:30:44,410 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-03-28T19:30:44,540 reading manifest template 'MANIFEST.in' 2025-03-28T19:30:44,542 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-03-28T19:30:44,542 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-03-28T19:30:46,294 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-03-28T19:30:50,257 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-03-28T19:30:53,268 warning: no files found matching '*.tr' under directory 'csrc' 2025-03-28T19:30:53,401 warning: no files found matching '*.cc' under directory 'csrc' 2025-03-28T19:30:53,452 warning: no files found matching '*.py' under directory 'benchmarks' 2025-03-28T19:30:53,459 adding license file 'LICENSE' 2025-03-28T19:30:53,511 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-03-28T19:30:53,521 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2025-03-28T19:30:53,522 !! 2025-03-28T19:30:53,522 ******************************************************************************** 2025-03-28T19:30:53,523 ############################ 2025-03-28T19:30:53,523 # Package would be ignored # 2025-03-28T19:30:53,524 ############################ 2025-03-28T19:30:53,524 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2025-03-28T19:30:53,525 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,525 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,526 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2025-03-28T19:30:53,526 to the `packages` configuration field. 2025-03-28T19:30:53,527 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,528 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,528 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,529 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,530 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,531 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2025-03-28T19:30:53,531 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2025-03-28T19:30:53,532 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,532 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,533 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,534 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,536 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,537 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,538 even if it does not contain any `.py` files. 2025-03-28T19:30:53,538 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,539 directory, all directories are treated like packages. 2025-03-28T19:30:53,540 ******************************************************************************** 2025-03-28T19:30:53,541 !! 2025-03-28T19:30:53,541 check.warn(importable) 2025-03-28T19:30:53,542 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration. 2025-03-28T19:30:53,542 !! 2025-03-28T19:30:53,544 ******************************************************************************** 2025-03-28T19:30:53,544 ############################ 2025-03-28T19:30:53,545 # Package would be ignored # 2025-03-28T19:30:53,545 ############################ 2025-03-28T19:30:53,546 Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1], 2025-03-28T19:30:53,547 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,548 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,548 package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added 2025-03-28T19:30:53,549 to the `packages` configuration field. 2025-03-28T19:30:53,551 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,551 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,552 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,552 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,553 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,554 If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are 2025-03-28T19:30:53,554 already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via 2025-03-28T19:30:53,555 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,555 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,555 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,556 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,557 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,558 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,559 even if it does not contain any `.py` files. 2025-03-28T19:30:53,559 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,560 directory, all directories are treated like packages. 2025-03-28T19:30:53,560 ******************************************************************************** 2025-03-28T19:30:53,561 !! 2025-03-28T19:30:53,561 check.warn(importable) 2025-03-28T19:30:53,562 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2025-03-28T19:30:53,562 !! 2025-03-28T19:30:53,564 ******************************************************************************** 2025-03-28T19:30:53,564 ############################ 2025-03-28T19:30:53,565 # Package would be ignored # 2025-03-28T19:30:53,565 ############################ 2025-03-28T19:30:53,566 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2025-03-28T19:30:53,566 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,567 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,568 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2025-03-28T19:30:53,568 to the `packages` configuration field. 2025-03-28T19:30:53,569 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,570 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,570 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,571 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,572 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,573 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2025-03-28T19:30:53,574 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2025-03-28T19:30:53,574 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,575 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,576 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,577 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,577 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,578 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,579 even if it does not contain any `.py` files. 2025-03-28T19:30:53,579 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,580 directory, all directories are treated like packages. 2025-03-28T19:30:53,580 ******************************************************************************** 2025-03-28T19:30:53,581 !! 2025-03-28T19:30:53,581 check.warn(importable) 2025-03-28T19:30:53,582 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2025-03-28T19:30:53,582 !! 2025-03-28T19:30:53,583 ******************************************************************************** 2025-03-28T19:30:53,583 ############################ 2025-03-28T19:30:53,584 # Package would be ignored # 2025-03-28T19:30:53,584 ############################ 2025-03-28T19:30:53,585 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2025-03-28T19:30:53,585 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,586 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,586 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2025-03-28T19:30:53,587 to the `packages` configuration field. 2025-03-28T19:30:53,587 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,588 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,589 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,590 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,591 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,592 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2025-03-28T19:30:53,592 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2025-03-28T19:30:53,593 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,593 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,594 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,594 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,595 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,597 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,597 even if it does not contain any `.py` files. 2025-03-28T19:30:53,598 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,598 directory, all directories are treated like packages. 2025-03-28T19:30:53,599 ******************************************************************************** 2025-03-28T19:30:53,600 !! 2025-03-28T19:30:53,600 check.warn(importable) 2025-03-28T19:30:53,601 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration. 2025-03-28T19:30:53,601 !! 2025-03-28T19:30:53,602 ******************************************************************************** 2025-03-28T19:30:53,603 ############################ 2025-03-28T19:30:53,603 # Package would be ignored # 2025-03-28T19:30:53,603 ############################ 2025-03-28T19:30:53,604 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1], 2025-03-28T19:30:53,604 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,605 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,605 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added 2025-03-28T19:30:53,606 to the `packages` configuration field. 2025-03-28T19:30:53,606 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,607 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,607 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,608 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,609 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,610 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are 2025-03-28T19:30:53,610 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via 2025-03-28T19:30:53,611 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,611 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,612 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,613 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,614 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,615 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,616 even if it does not contain any `.py` files. 2025-03-28T19:30:53,616 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,617 directory, all directories are treated like packages. 2025-03-28T19:30:53,617 ******************************************************************************** 2025-03-28T19:30:53,619 !! 2025-03-28T19:30:53,619 check.warn(importable) 2025-03-28T19:30:53,620 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2025-03-28T19:30:53,620 !! 2025-03-28T19:30:53,621 ******************************************************************************** 2025-03-28T19:30:53,622 ############################ 2025-03-28T19:30:53,622 # Package would be ignored # 2025-03-28T19:30:53,623 ############################ 2025-03-28T19:30:53,623 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2025-03-28T19:30:53,624 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,624 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,625 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2025-03-28T19:30:53,625 to the `packages` configuration field. 2025-03-28T19:30:53,627 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,627 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,628 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,629 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,629 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,630 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2025-03-28T19:30:53,630 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2025-03-28T19:30:53,631 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,631 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,631 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,632 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,633 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,634 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,634 even if it does not contain any `.py` files. 2025-03-28T19:30:53,635 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,635 directory, all directories are treated like packages. 2025-03-28T19:30:53,636 ******************************************************************************** 2025-03-28T19:30:53,637 !! 2025-03-28T19:30:53,637 check.warn(importable) 2025-03-28T19:30:53,637 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2025-03-28T19:30:53,638 !! 2025-03-28T19:30:53,639 ******************************************************************************** 2025-03-28T19:30:53,639 ############################ 2025-03-28T19:30:53,640 # Package would be ignored # 2025-03-28T19:30:53,640 ############################ 2025-03-28T19:30:53,641 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2025-03-28T19:30:53,641 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,643 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,643 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2025-03-28T19:30:53,644 to the `packages` configuration field. 2025-03-28T19:30:53,645 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,645 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,646 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,647 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,647 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,648 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2025-03-28T19:30:53,649 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2025-03-28T19:30:53,649 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,650 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,650 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,651 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,653 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,654 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,655 even if it does not contain any `.py` files. 2025-03-28T19:30:53,656 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,656 directory, all directories are treated like packages. 2025-03-28T19:30:53,657 ******************************************************************************** 2025-03-28T19:30:53,657 !! 2025-03-28T19:30:53,658 check.warn(importable) 2025-03-28T19:30:53,658 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2025-03-28T19:30:53,658 !! 2025-03-28T19:30:53,659 ******************************************************************************** 2025-03-28T19:30:53,659 ############################ 2025-03-28T19:30:53,660 # Package would be ignored # 2025-03-28T19:30:53,660 ############################ 2025-03-28T19:30:53,661 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2025-03-28T19:30:53,661 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,662 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,662 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2025-03-28T19:30:53,662 to the `packages` configuration field. 2025-03-28T19:30:53,663 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,664 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,664 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,665 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,666 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,667 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2025-03-28T19:30:53,668 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2025-03-28T19:30:53,668 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,669 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,669 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,670 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,671 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,672 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,673 even if it does not contain any `.py` files. 2025-03-28T19:30:53,673 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,674 directory, all directories are treated like packages. 2025-03-28T19:30:53,674 ******************************************************************************** 2025-03-28T19:30:53,675 !! 2025-03-28T19:30:53,676 check.warn(importable) 2025-03-28T19:30:53,676 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2025-03-28T19:30:53,677 !! 2025-03-28T19:30:53,678 ******************************************************************************** 2025-03-28T19:30:53,678 ############################ 2025-03-28T19:30:53,679 # Package would be ignored # 2025-03-28T19:30:53,679 ############################ 2025-03-28T19:30:53,680 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2025-03-28T19:30:53,680 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,681 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,682 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2025-03-28T19:30:53,682 to the `packages` configuration field. 2025-03-28T19:30:53,683 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,683 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,684 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,685 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,685 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,686 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2025-03-28T19:30:53,687 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2025-03-28T19:30:53,687 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,688 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,688 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,689 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,690 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,691 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,692 even if it does not contain any `.py` files. 2025-03-28T19:30:53,692 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,692 directory, all directories are treated like packages. 2025-03-28T19:30:53,693 ******************************************************************************** 2025-03-28T19:30:53,694 !! 2025-03-28T19:30:53,694 check.warn(importable) 2025-03-28T19:30:53,695 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2025-03-28T19:30:53,696 !! 2025-03-28T19:30:53,697 ******************************************************************************** 2025-03-28T19:30:53,697 ############################ 2025-03-28T19:30:53,698 # Package would be ignored # 2025-03-28T19:30:53,698 ############################ 2025-03-28T19:30:53,699 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2025-03-28T19:30:53,700 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,700 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,701 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2025-03-28T19:30:53,701 to the `packages` configuration field. 2025-03-28T19:30:53,702 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,703 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,704 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,704 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,706 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,707 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2025-03-28T19:30:53,708 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2025-03-28T19:30:53,708 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,709 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,709 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,710 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,711 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,712 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,713 even if it does not contain any `.py` files. 2025-03-28T19:30:53,713 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,713 directory, all directories are treated like packages. 2025-03-28T19:30:53,714 ******************************************************************************** 2025-03-28T19:30:53,715 !! 2025-03-28T19:30:53,715 check.warn(importable) 2025-03-28T19:30:53,715 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2025-03-28T19:30:53,716 !! 2025-03-28T19:30:53,717 ******************************************************************************** 2025-03-28T19:30:53,717 ############################ 2025-03-28T19:30:53,718 # Package would be ignored # 2025-03-28T19:30:53,718 ############################ 2025-03-28T19:30:53,718 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2025-03-28T19:30:53,719 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,720 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,720 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2025-03-28T19:30:53,721 to the `packages` configuration field. 2025-03-28T19:30:53,722 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,722 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,723 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,724 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,725 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,726 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2025-03-28T19:30:53,726 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2025-03-28T19:30:53,727 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,727 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,728 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,729 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,730 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,732 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,732 even if it does not contain any `.py` files. 2025-03-28T19:30:53,733 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,733 directory, all directories are treated like packages. 2025-03-28T19:30:53,734 ******************************************************************************** 2025-03-28T19:30:53,735 !! 2025-03-28T19:30:53,735 check.warn(importable) 2025-03-28T19:30:53,736 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2025-03-28T19:30:53,736 !! 2025-03-28T19:30:53,738 ******************************************************************************** 2025-03-28T19:30:53,738 ############################ 2025-03-28T19:30:53,739 # Package would be ignored # 2025-03-28T19:30:53,739 ############################ 2025-03-28T19:30:53,740 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2025-03-28T19:30:53,740 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,741 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,741 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2025-03-28T19:30:53,741 to the `packages` configuration field. 2025-03-28T19:30:53,742 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,742 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,743 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,743 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,744 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,745 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2025-03-28T19:30:53,746 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2025-03-28T19:30:53,746 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,747 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,747 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,748 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,749 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,750 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,751 even if it does not contain any `.py` files. 2025-03-28T19:30:53,752 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,752 directory, all directories are treated like packages. 2025-03-28T19:30:53,752 ******************************************************************************** 2025-03-28T19:30:53,754 !! 2025-03-28T19:30:53,754 check.warn(importable) 2025-03-28T19:30:53,754 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2025-03-28T19:30:53,755 !! 2025-03-28T19:30:53,756 ******************************************************************************** 2025-03-28T19:30:53,757 ############################ 2025-03-28T19:30:53,757 # Package would be ignored # 2025-03-28T19:30:53,757 ############################ 2025-03-28T19:30:53,758 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2025-03-28T19:30:53,758 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,760 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,760 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2025-03-28T19:30:53,761 to the `packages` configuration field. 2025-03-28T19:30:53,762 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,762 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,763 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,764 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,766 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,767 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2025-03-28T19:30:53,767 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2025-03-28T19:30:53,768 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,768 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,768 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,769 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,770 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,771 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,772 even if it does not contain any `.py` files. 2025-03-28T19:30:53,772 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,773 directory, all directories are treated like packages. 2025-03-28T19:30:53,773 ******************************************************************************** 2025-03-28T19:30:53,774 !! 2025-03-28T19:30:53,774 check.warn(importable) 2025-03-28T19:30:53,775 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2025-03-28T19:30:53,775 !! 2025-03-28T19:30:53,777 ******************************************************************************** 2025-03-28T19:30:53,777 ############################ 2025-03-28T19:30:53,777 # Package would be ignored # 2025-03-28T19:30:53,778 ############################ 2025-03-28T19:30:53,778 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2025-03-28T19:30:53,779 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,780 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,781 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2025-03-28T19:30:53,781 to the `packages` configuration field. 2025-03-28T19:30:53,782 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,783 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,783 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,784 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,786 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,788 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2025-03-28T19:30:53,789 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2025-03-28T19:30:53,789 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,790 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,791 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,793 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,795 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,797 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,798 even if it does not contain any `.py` files. 2025-03-28T19:30:53,799 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,800 directory, all directories are treated like packages. 2025-03-28T19:30:53,800 ******************************************************************************** 2025-03-28T19:30:53,801 !! 2025-03-28T19:30:53,802 check.warn(importable) 2025-03-28T19:30:53,802 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2025-03-28T19:30:53,802 !! 2025-03-28T19:30:53,803 ******************************************************************************** 2025-03-28T19:30:53,804 ############################ 2025-03-28T19:30:53,804 # Package would be ignored # 2025-03-28T19:30:53,805 ############################ 2025-03-28T19:30:53,805 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2025-03-28T19:30:53,805 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,806 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,806 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2025-03-28T19:30:53,807 to the `packages` configuration field. 2025-03-28T19:30:53,808 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,808 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,809 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,810 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,811 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,812 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2025-03-28T19:30:53,813 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2025-03-28T19:30:53,813 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,814 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,814 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,815 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,816 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,818 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,818 even if it does not contain any `.py` files. 2025-03-28T19:30:53,819 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,819 directory, all directories are treated like packages. 2025-03-28T19:30:53,820 ******************************************************************************** 2025-03-28T19:30:53,821 !! 2025-03-28T19:30:53,821 check.warn(importable) 2025-03-28T19:30:53,822 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2025-03-28T19:30:53,823 !! 2025-03-28T19:30:53,824 ******************************************************************************** 2025-03-28T19:30:53,824 ############################ 2025-03-28T19:30:53,825 # Package would be ignored # 2025-03-28T19:30:53,825 ############################ 2025-03-28T19:30:53,825 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2025-03-28T19:30:53,827 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,829 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,829 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2025-03-28T19:30:53,830 to the `packages` configuration field. 2025-03-28T19:30:53,832 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,832 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,833 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,833 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,834 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,835 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2025-03-28T19:30:53,836 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2025-03-28T19:30:53,836 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,836 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,837 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,838 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,839 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,841 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,841 even if it does not contain any `.py` files. 2025-03-28T19:30:53,842 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,842 directory, all directories are treated like packages. 2025-03-28T19:30:53,843 ******************************************************************************** 2025-03-28T19:30:53,845 !! 2025-03-28T19:30:53,845 check.warn(importable) 2025-03-28T19:30:53,846 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2025-03-28T19:30:53,847 !! 2025-03-28T19:30:53,849 ******************************************************************************** 2025-03-28T19:30:53,851 ############################ 2025-03-28T19:30:53,852 # Package would be ignored # 2025-03-28T19:30:53,853 ############################ 2025-03-28T19:30:53,854 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2025-03-28T19:30:53,855 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,856 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,857 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2025-03-28T19:30:53,858 to the `packages` configuration field. 2025-03-28T19:30:53,859 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,859 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,860 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,861 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,862 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,863 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2025-03-28T19:30:53,864 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2025-03-28T19:30:53,864 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,865 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,866 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,867 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,868 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,869 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,869 even if it does not contain any `.py` files. 2025-03-28T19:30:53,870 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,870 directory, all directories are treated like packages. 2025-03-28T19:30:53,870 ******************************************************************************** 2025-03-28T19:30:53,872 !! 2025-03-28T19:30:53,872 check.warn(importable) 2025-03-28T19:30:53,872 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2025-03-28T19:30:53,873 !! 2025-03-28T19:30:53,873 ******************************************************************************** 2025-03-28T19:30:53,874 ############################ 2025-03-28T19:30:53,874 # Package would be ignored # 2025-03-28T19:30:53,875 ############################ 2025-03-28T19:30:53,876 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2025-03-28T19:30:53,876 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,877 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,877 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2025-03-28T19:30:53,878 to the `packages` configuration field. 2025-03-28T19:30:53,879 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,879 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,880 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,881 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,882 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,884 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2025-03-28T19:30:53,884 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2025-03-28T19:30:53,885 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,886 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,886 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,888 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,889 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,890 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,891 even if it does not contain any `.py` files. 2025-03-28T19:30:53,891 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,892 directory, all directories are treated like packages. 2025-03-28T19:30:53,893 ******************************************************************************** 2025-03-28T19:30:53,894 !! 2025-03-28T19:30:53,895 check.warn(importable) 2025-03-28T19:30:53,895 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2025-03-28T19:30:53,896 !! 2025-03-28T19:30:53,898 ******************************************************************************** 2025-03-28T19:30:53,898 ############################ 2025-03-28T19:30:53,900 # Package would be ignored # 2025-03-28T19:30:53,900 ############################ 2025-03-28T19:30:53,900 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2025-03-28T19:30:53,901 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,902 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,902 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2025-03-28T19:30:53,902 to the `packages` configuration field. 2025-03-28T19:30:53,903 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,904 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,904 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,905 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,907 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,908 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2025-03-28T19:30:53,909 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2025-03-28T19:30:53,910 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,910 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,911 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,913 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,915 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,918 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,919 even if it does not contain any `.py` files. 2025-03-28T19:30:53,920 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,921 directory, all directories are treated like packages. 2025-03-28T19:30:53,923 ******************************************************************************** 2025-03-28T19:30:53,925 !! 2025-03-28T19:30:53,926 check.warn(importable) 2025-03-28T19:30:53,926 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2025-03-28T19:30:53,927 !! 2025-03-28T19:30:53,928 ******************************************************************************** 2025-03-28T19:30:53,929 ############################ 2025-03-28T19:30:53,930 # Package would be ignored # 2025-03-28T19:30:53,930 ############################ 2025-03-28T19:30:53,931 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2025-03-28T19:30:53,932 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,934 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,935 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2025-03-28T19:30:53,937 to the `packages` configuration field. 2025-03-28T19:30:53,939 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,939 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,940 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,942 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,943 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,943 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2025-03-28T19:30:53,944 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2025-03-28T19:30:53,944 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,945 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,945 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,946 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,946 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,948 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,948 even if it does not contain any `.py` files. 2025-03-28T19:30:53,949 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,949 directory, all directories are treated like packages. 2025-03-28T19:30:53,950 ******************************************************************************** 2025-03-28T19:30:53,951 !! 2025-03-28T19:30:53,951 check.warn(importable) 2025-03-28T19:30:53,952 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2025-03-28T19:30:53,952 !! 2025-03-28T19:30:53,953 ******************************************************************************** 2025-03-28T19:30:53,954 ############################ 2025-03-28T19:30:53,954 # Package would be ignored # 2025-03-28T19:30:53,955 ############################ 2025-03-28T19:30:53,955 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2025-03-28T19:30:53,956 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,957 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,957 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2025-03-28T19:30:53,958 to the `packages` configuration field. 2025-03-28T19:30:53,959 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,960 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,960 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,961 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,962 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,963 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2025-03-28T19:30:53,964 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2025-03-28T19:30:53,964 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,965 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,965 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,966 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,967 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,969 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,969 even if it does not contain any `.py` files. 2025-03-28T19:30:53,969 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,970 directory, all directories are treated like packages. 2025-03-28T19:30:53,970 ******************************************************************************** 2025-03-28T19:30:53,971 !! 2025-03-28T19:30:53,971 check.warn(importable) 2025-03-28T19:30:53,971 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration. 2025-03-28T19:30:53,972 !! 2025-03-28T19:30:53,973 ******************************************************************************** 2025-03-28T19:30:53,973 ############################ 2025-03-28T19:30:53,973 # Package would be ignored # 2025-03-28T19:30:53,974 ############################ 2025-03-28T19:30:53,974 Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1], 2025-03-28T19:30:53,974 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,975 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,975 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added 2025-03-28T19:30:53,976 to the `packages` configuration field. 2025-03-28T19:30:53,977 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,977 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,977 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,978 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,979 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,980 If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are 2025-03-28T19:30:53,981 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via 2025-03-28T19:30:53,982 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:53,982 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:53,983 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:53,984 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:53,984 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:53,986 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:53,986 even if it does not contain any `.py` files. 2025-03-28T19:30:53,987 On the other hand, currently there is no concept of package data 2025-03-28T19:30:53,987 directory, all directories are treated like packages. 2025-03-28T19:30:53,988 ******************************************************************************** 2025-03-28T19:30:53,989 !! 2025-03-28T19:30:53,989 check.warn(importable) 2025-03-28T19:30:53,989 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration. 2025-03-28T19:30:53,990 !! 2025-03-28T19:30:53,991 ******************************************************************************** 2025-03-28T19:30:53,991 ############################ 2025-03-28T19:30:53,992 # Package would be ignored # 2025-03-28T19:30:53,993 ############################ 2025-03-28T19:30:53,993 Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1], 2025-03-28T19:30:53,994 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:53,995 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:53,995 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added 2025-03-28T19:30:53,996 to the `packages` configuration field. 2025-03-28T19:30:53,996 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:53,997 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:53,997 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:53,998 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:53,999 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:53,999 If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are 2025-03-28T19:30:54,000 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via 2025-03-28T19:30:54,000 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,001 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,001 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,002 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,003 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,004 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,005 even if it does not contain any `.py` files. 2025-03-28T19:30:54,005 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,005 directory, all directories are treated like packages. 2025-03-28T19:30:54,006 ******************************************************************************** 2025-03-28T19:30:54,007 !! 2025-03-28T19:30:54,007 check.warn(importable) 2025-03-28T19:30:54,008 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration. 2025-03-28T19:30:54,008 !! 2025-03-28T19:30:54,009 ******************************************************************************** 2025-03-28T19:30:54,010 ############################ 2025-03-28T19:30:54,010 # Package would be ignored # 2025-03-28T19:30:54,011 ############################ 2025-03-28T19:30:54,012 Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1], 2025-03-28T19:30:54,012 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,013 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,013 package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added 2025-03-28T19:30:54,014 to the `packages` configuration field. 2025-03-28T19:30:54,015 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,015 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,016 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,017 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,018 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,019 If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are 2025-03-28T19:30:54,020 already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via 2025-03-28T19:30:54,020 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,021 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,021 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,022 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,023 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,024 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,025 even if it does not contain any `.py` files. 2025-03-28T19:30:54,025 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,025 directory, all directories are treated like packages. 2025-03-28T19:30:54,026 ******************************************************************************** 2025-03-28T19:30:54,027 !! 2025-03-28T19:30:54,027 check.warn(importable) 2025-03-28T19:30:54,028 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2025-03-28T19:30:54,028 !! 2025-03-28T19:30:54,029 ******************************************************************************** 2025-03-28T19:30:54,029 ############################ 2025-03-28T19:30:54,030 # Package would be ignored # 2025-03-28T19:30:54,030 ############################ 2025-03-28T19:30:54,031 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2025-03-28T19:30:54,032 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,033 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,033 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2025-03-28T19:30:54,034 to the `packages` configuration field. 2025-03-28T19:30:54,035 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,035 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,036 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,037 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,038 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,039 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2025-03-28T19:30:54,040 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2025-03-28T19:30:54,040 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,041 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,041 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,042 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,043 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,045 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,045 even if it does not contain any `.py` files. 2025-03-28T19:30:54,046 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,046 directory, all directories are treated like packages. 2025-03-28T19:30:54,047 ******************************************************************************** 2025-03-28T19:30:54,048 !! 2025-03-28T19:30:54,049 check.warn(importable) 2025-03-28T19:30:54,049 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2025-03-28T19:30:54,050 !! 2025-03-28T19:30:54,051 ******************************************************************************** 2025-03-28T19:30:54,052 ############################ 2025-03-28T19:30:54,052 # Package would be ignored # 2025-03-28T19:30:54,053 ############################ 2025-03-28T19:30:54,053 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2025-03-28T19:30:54,054 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,055 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,055 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2025-03-28T19:30:54,055 to the `packages` configuration field. 2025-03-28T19:30:54,056 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,057 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,057 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,058 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,059 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,060 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2025-03-28T19:30:54,061 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2025-03-28T19:30:54,061 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,062 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,062 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,063 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,065 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,066 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,067 even if it does not contain any `.py` files. 2025-03-28T19:30:54,067 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,068 directory, all directories are treated like packages. 2025-03-28T19:30:54,068 ******************************************************************************** 2025-03-28T19:30:54,069 !! 2025-03-28T19:30:54,070 check.warn(importable) 2025-03-28T19:30:54,070 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2025-03-28T19:30:54,071 !! 2025-03-28T19:30:54,072 ******************************************************************************** 2025-03-28T19:30:54,073 ############################ 2025-03-28T19:30:54,073 # Package would be ignored # 2025-03-28T19:30:54,074 ############################ 2025-03-28T19:30:54,074 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2025-03-28T19:30:54,075 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,076 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,077 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2025-03-28T19:30:54,077 to the `packages` configuration field. 2025-03-28T19:30:54,079 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,079 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,080 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,081 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,082 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,083 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2025-03-28T19:30:54,083 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2025-03-28T19:30:54,084 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,084 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,085 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,086 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,087 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,089 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,089 even if it does not contain any `.py` files. 2025-03-28T19:30:54,090 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,090 directory, all directories are treated like packages. 2025-03-28T19:30:54,091 ******************************************************************************** 2025-03-28T19:30:54,092 !! 2025-03-28T19:30:54,092 check.warn(importable) 2025-03-28T19:30:54,093 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2025-03-28T19:30:54,093 !! 2025-03-28T19:30:54,094 ******************************************************************************** 2025-03-28T19:30:54,095 ############################ 2025-03-28T19:30:54,095 # Package would be ignored # 2025-03-28T19:30:54,096 ############################ 2025-03-28T19:30:54,096 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2025-03-28T19:30:54,097 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,098 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,099 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2025-03-28T19:30:54,099 to the `packages` configuration field. 2025-03-28T19:30:54,100 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,101 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,102 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,103 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,104 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,105 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2025-03-28T19:30:54,106 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2025-03-28T19:30:54,106 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,107 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,108 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,109 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,110 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,111 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,112 even if it does not contain any `.py` files. 2025-03-28T19:30:54,112 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,113 directory, all directories are treated like packages. 2025-03-28T19:30:54,114 ******************************************************************************** 2025-03-28T19:30:54,114 !! 2025-03-28T19:30:54,115 check.warn(importable) 2025-03-28T19:30:54,115 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2025-03-28T19:30:54,116 !! 2025-03-28T19:30:54,117 ******************************************************************************** 2025-03-28T19:30:54,117 ############################ 2025-03-28T19:30:54,117 # Package would be ignored # 2025-03-28T19:30:54,118 ############################ 2025-03-28T19:30:54,118 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2025-03-28T19:30:54,119 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,120 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,120 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2025-03-28T19:30:54,120 to the `packages` configuration field. 2025-03-28T19:30:54,121 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,122 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,122 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,123 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,124 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,125 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2025-03-28T19:30:54,125 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2025-03-28T19:30:54,126 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,127 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,127 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,128 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,129 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,131 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,131 even if it does not contain any `.py` files. 2025-03-28T19:30:54,132 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,132 directory, all directories are treated like packages. 2025-03-28T19:30:54,133 ******************************************************************************** 2025-03-28T19:30:54,134 !! 2025-03-28T19:30:54,135 check.warn(importable) 2025-03-28T19:30:54,135 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2025-03-28T19:30:54,136 !! 2025-03-28T19:30:54,136 ******************************************************************************** 2025-03-28T19:30:54,137 ############################ 2025-03-28T19:30:54,137 # Package would be ignored # 2025-03-28T19:30:54,138 ############################ 2025-03-28T19:30:54,139 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2025-03-28T19:30:54,139 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,140 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,141 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2025-03-28T19:30:54,141 to the `packages` configuration field. 2025-03-28T19:30:54,142 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,143 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,143 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,144 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,145 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,146 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2025-03-28T19:30:54,146 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2025-03-28T19:30:54,146 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,147 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,148 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,148 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,149 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,150 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,151 even if it does not contain any `.py` files. 2025-03-28T19:30:54,152 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,152 directory, all directories are treated like packages. 2025-03-28T19:30:54,153 ******************************************************************************** 2025-03-28T19:30:54,154 !! 2025-03-28T19:30:54,154 check.warn(importable) 2025-03-28T19:30:54,155 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2025-03-28T19:30:54,155 !! 2025-03-28T19:30:54,156 ******************************************************************************** 2025-03-28T19:30:54,157 ############################ 2025-03-28T19:30:54,157 # Package would be ignored # 2025-03-28T19:30:54,158 ############################ 2025-03-28T19:30:54,158 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2025-03-28T19:30:54,159 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,160 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,160 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2025-03-28T19:30:54,161 to the `packages` configuration field. 2025-03-28T19:30:54,162 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,162 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,163 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,164 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,165 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,166 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2025-03-28T19:30:54,166 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2025-03-28T19:30:54,167 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,167 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,168 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,169 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,170 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,172 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,172 even if it does not contain any `.py` files. 2025-03-28T19:30:54,173 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,173 directory, all directories are treated like packages. 2025-03-28T19:30:54,173 ******************************************************************************** 2025-03-28T19:30:54,174 !! 2025-03-28T19:30:54,175 check.warn(importable) 2025-03-28T19:30:54,175 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2025-03-28T19:30:54,175 !! 2025-03-28T19:30:54,176 ******************************************************************************** 2025-03-28T19:30:54,177 ############################ 2025-03-28T19:30:54,177 # Package would be ignored # 2025-03-28T19:30:54,178 ############################ 2025-03-28T19:30:54,178 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2025-03-28T19:30:54,178 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,179 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,180 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2025-03-28T19:30:54,180 to the `packages` configuration field. 2025-03-28T19:30:54,181 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,182 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,182 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,183 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,184 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,185 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2025-03-28T19:30:54,185 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2025-03-28T19:30:54,186 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,186 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,187 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,188 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,189 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,191 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,191 even if it does not contain any `.py` files. 2025-03-28T19:30:54,192 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,192 directory, all directories are treated like packages. 2025-03-28T19:30:54,193 ******************************************************************************** 2025-03-28T19:30:54,194 !! 2025-03-28T19:30:54,194 check.warn(importable) 2025-03-28T19:30:54,195 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2025-03-28T19:30:54,195 !! 2025-03-28T19:30:54,197 ******************************************************************************** 2025-03-28T19:30:54,198 ############################ 2025-03-28T19:30:54,198 # Package would be ignored # 2025-03-28T19:30:54,199 ############################ 2025-03-28T19:30:54,200 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2025-03-28T19:30:54,201 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,202 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,202 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2025-03-28T19:30:54,203 to the `packages` configuration field. 2025-03-28T19:30:54,204 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,204 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,205 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,206 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,207 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,208 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2025-03-28T19:30:54,209 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2025-03-28T19:30:54,209 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,210 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,210 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,212 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,213 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,214 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,215 even if it does not contain any `.py` files. 2025-03-28T19:30:54,215 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,216 directory, all directories are treated like packages. 2025-03-28T19:30:54,216 ******************************************************************************** 2025-03-28T19:30:54,217 !! 2025-03-28T19:30:54,218 check.warn(importable) 2025-03-28T19:30:54,218 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2025-03-28T19:30:54,219 !! 2025-03-28T19:30:54,220 ******************************************************************************** 2025-03-28T19:30:54,221 ############################ 2025-03-28T19:30:54,221 # Package would be ignored # 2025-03-28T19:30:54,222 ############################ 2025-03-28T19:30:54,222 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2025-03-28T19:30:54,223 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,224 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,225 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2025-03-28T19:30:54,225 to the `packages` configuration field. 2025-03-28T19:30:54,226 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,227 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,227 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,228 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,229 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,231 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2025-03-28T19:30:54,231 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2025-03-28T19:30:54,231 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,232 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,232 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,233 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,234 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,235 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,235 even if it does not contain any `.py` files. 2025-03-28T19:30:54,236 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,236 directory, all directories are treated like packages. 2025-03-28T19:30:54,237 ******************************************************************************** 2025-03-28T19:30:54,238 !! 2025-03-28T19:30:54,238 check.warn(importable) 2025-03-28T19:30:54,238 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2025-03-28T19:30:54,239 !! 2025-03-28T19:30:54,240 ******************************************************************************** 2025-03-28T19:30:54,241 ############################ 2025-03-28T19:30:54,241 # Package would be ignored # 2025-03-28T19:30:54,242 ############################ 2025-03-28T19:30:54,242 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2025-03-28T19:30:54,243 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,244 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,244 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2025-03-28T19:30:54,245 to the `packages` configuration field. 2025-03-28T19:30:54,246 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,246 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,247 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,248 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,250 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,251 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2025-03-28T19:30:54,251 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2025-03-28T19:30:54,252 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,252 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,253 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,254 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,255 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,256 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,257 even if it does not contain any `.py` files. 2025-03-28T19:30:54,258 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,258 directory, all directories are treated like packages. 2025-03-28T19:30:54,259 ******************************************************************************** 2025-03-28T19:30:54,260 !! 2025-03-28T19:30:54,260 check.warn(importable) 2025-03-28T19:30:54,261 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2025-03-28T19:30:54,261 !! 2025-03-28T19:30:54,262 ******************************************************************************** 2025-03-28T19:30:54,263 ############################ 2025-03-28T19:30:54,263 # Package would be ignored # 2025-03-28T19:30:54,264 ############################ 2025-03-28T19:30:54,264 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2025-03-28T19:30:54,265 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,266 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,266 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2025-03-28T19:30:54,267 to the `packages` configuration field. 2025-03-28T19:30:54,268 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,268 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,268 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,269 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,270 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,271 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2025-03-28T19:30:54,272 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2025-03-28T19:30:54,272 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,273 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,273 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,274 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,275 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,277 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,277 even if it does not contain any `.py` files. 2025-03-28T19:30:54,278 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,278 directory, all directories are treated like packages. 2025-03-28T19:30:54,279 ******************************************************************************** 2025-03-28T19:30:54,280 !! 2025-03-28T19:30:54,280 check.warn(importable) 2025-03-28T19:30:54,281 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration. 2025-03-28T19:30:54,281 !! 2025-03-28T19:30:54,283 ******************************************************************************** 2025-03-28T19:30:54,283 ############################ 2025-03-28T19:30:54,283 # Package would be ignored # 2025-03-28T19:30:54,284 ############################ 2025-03-28T19:30:54,284 Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1], 2025-03-28T19:30:54,285 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,286 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,287 package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added 2025-03-28T19:30:54,287 to the `packages` configuration field. 2025-03-28T19:30:54,289 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,289 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,289 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,291 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,291 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,292 If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are 2025-03-28T19:30:54,293 already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via 2025-03-28T19:30:54,293 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,294 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,294 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,295 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,296 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,298 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,298 even if it does not contain any `.py` files. 2025-03-28T19:30:54,299 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,299 directory, all directories are treated like packages. 2025-03-28T19:30:54,300 ******************************************************************************** 2025-03-28T19:30:54,301 !! 2025-03-28T19:30:54,301 check.warn(importable) 2025-03-28T19:30:54,302 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration. 2025-03-28T19:30:54,302 !! 2025-03-28T19:30:54,304 ******************************************************************************** 2025-03-28T19:30:54,304 ############################ 2025-03-28T19:30:54,305 # Package would be ignored # 2025-03-28T19:30:54,305 ############################ 2025-03-28T19:30:54,306 Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1], 2025-03-28T19:30:54,306 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,307 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,308 package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added 2025-03-28T19:30:54,308 to the `packages` configuration field. 2025-03-28T19:30:54,309 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,309 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,310 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,311 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,312 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,313 If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are 2025-03-28T19:30:54,314 already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via 2025-03-28T19:30:54,314 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,315 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,315 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,316 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,317 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,319 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,320 even if it does not contain any `.py` files. 2025-03-28T19:30:54,320 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,320 directory, all directories are treated like packages. 2025-03-28T19:30:54,321 ******************************************************************************** 2025-03-28T19:30:54,322 !! 2025-03-28T19:30:54,323 check.warn(importable) 2025-03-28T19:30:54,323 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration. 2025-03-28T19:30:54,324 !! 2025-03-28T19:30:54,324 ******************************************************************************** 2025-03-28T19:30:54,325 ############################ 2025-03-28T19:30:54,325 # Package would be ignored # 2025-03-28T19:30:54,326 ############################ 2025-03-28T19:30:54,326 Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1], 2025-03-28T19:30:54,326 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,327 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,328 package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added 2025-03-28T19:30:54,328 to the `packages` configuration field. 2025-03-28T19:30:54,329 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,330 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,330 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,331 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,332 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,333 If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are 2025-03-28T19:30:54,334 already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via 2025-03-28T19:30:54,334 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,335 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,336 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,337 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,338 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,339 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,340 even if it does not contain any `.py` files. 2025-03-28T19:30:54,340 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,341 directory, all directories are treated like packages. 2025-03-28T19:30:54,341 ******************************************************************************** 2025-03-28T19:30:54,342 !! 2025-03-28T19:30:54,343 check.warn(importable) 2025-03-28T19:30:54,343 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration. 2025-03-28T19:30:54,343 !! 2025-03-28T19:30:54,344 ******************************************************************************** 2025-03-28T19:30:54,345 ############################ 2025-03-28T19:30:54,346 # Package would be ignored # 2025-03-28T19:30:54,346 ############################ 2025-03-28T19:30:54,347 Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1], 2025-03-28T19:30:54,347 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,348 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,349 package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added 2025-03-28T19:30:54,349 to the `packages` configuration field. 2025-03-28T19:30:54,350 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,350 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,351 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,352 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,352 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,353 If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are 2025-03-28T19:30:54,354 already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via 2025-03-28T19:30:54,354 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,355 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,355 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,356 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,357 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,358 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,359 even if it does not contain any `.py` files. 2025-03-28T19:30:54,360 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,360 directory, all directories are treated like packages. 2025-03-28T19:30:54,360 ******************************************************************************** 2025-03-28T19:30:54,361 !! 2025-03-28T19:30:54,362 check.warn(importable) 2025-03-28T19:30:54,362 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration. 2025-03-28T19:30:54,363 !! 2025-03-28T19:30:54,364 ******************************************************************************** 2025-03-28T19:30:54,365 ############################ 2025-03-28T19:30:54,365 # Package would be ignored # 2025-03-28T19:30:54,366 ############################ 2025-03-28T19:30:54,366 Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1], 2025-03-28T19:30:54,367 but it is absent from setuptools' `packages` configuration. 2025-03-28T19:30:54,368 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-28T19:30:54,368 package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added 2025-03-28T19:30:54,369 to the `packages` configuration field. 2025-03-28T19:30:54,370 Alternatively, you can also rely on setuptools' discovery methods 2025-03-28T19:30:54,370 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-28T19:30:54,371 instead of `find_packages(...)`/`find:`). 2025-03-28T19:30:54,372 You can read more about "package discovery" on setuptools documentation page: 2025-03-28T19:30:54,373 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-28T19:30:54,374 If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are 2025-03-28T19:30:54,374 already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via 2025-03-28T19:30:54,375 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-28T19:30:54,376 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-28T19:30:54,376 combination with a more fine grained `package-data` configuration. 2025-03-28T19:30:54,377 You can read more about "package data files" on setuptools documentation page: 2025-03-28T19:30:54,378 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-28T19:30:54,379 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-28T19:30:54,379 even if it does not contain any `.py` files. 2025-03-28T19:30:54,380 On the other hand, currently there is no concept of package data 2025-03-28T19:30:54,380 directory, all directories are treated like packages. 2025-03-28T19:30:54,381 ******************************************************************************** 2025-03-28T19:30:54,382 !! 2025-03-28T19:30:54,382 check.warn(importable) 2025-03-28T19:30:54,382 creating build/lib/deepspeed/autotuning/config_templates 2025-03-28T19:30:54,383 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2025-03-28T19:30:54,383 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2025-03-28T19:30:54,384 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2025-03-28T19:30:54,384 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2025-03-28T19:30:54,385 creating build/lib/deepspeed/ops/csrc/adagrad 2025-03-28T19:30:54,385 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2025-03-28T19:30:54,386 creating build/lib/deepspeed/ops/csrc/adam 2025-03-28T19:30:54,386 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-03-28T19:30:54,387 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-03-28T19:30:54,387 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-03-28T19:30:54,387 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2025-03-28T19:30:54,388 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2025-03-28T19:30:54,388 creating build/lib/deepspeed/ops/csrc/aio/common 2025-03-28T19:30:54,389 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-03-28T19:30:54,389 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-03-28T19:30:54,390 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-03-28T19:30:54,390 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-03-28T19:30:54,391 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-03-28T19:30:54,391 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-03-28T19:30:54,392 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,392 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,393 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,393 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,394 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,394 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,395 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,396 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,396 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,397 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,397 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,397 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,398 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,398 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,399 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,400 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,400 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,400 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:54,401 creating build/lib/deepspeed/ops/csrc/aio/py_test 2025-03-28T19:30:54,401 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2025-03-28T19:30:54,402 creating build/lib/deepspeed/ops/csrc/cpu/adam 2025-03-28T19:30:54,402 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2025-03-28T19:30:54,403 creating build/lib/deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:54,403 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:54,404 copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:54,404 copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:54,405 copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:54,405 creating build/lib/deepspeed/ops/csrc/cpu/lion 2025-03-28T19:30:54,406 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2025-03-28T19:30:54,406 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:54,407 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:54,408 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:54,408 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:54,409 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:54,409 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:54,410 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:54,410 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:54,411 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:54,412 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:54,412 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:54,413 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:54,413 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:54,413 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:54,414 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:54,414 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:54,415 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:54,416 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:54,416 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:54,417 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:54,417 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:54,417 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:54,418 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:54,419 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:54,419 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:54,420 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:54,420 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:54,421 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:54,422 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-03-28T19:30:54,422 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-03-28T19:30:54,423 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-03-28T19:30:54,424 creating build/lib/deepspeed/ops/csrc/fp_quantizer 2025-03-28T19:30:54,425 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-03-28T19:30:54,425 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-03-28T19:30:54,426 creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-03-28T19:30:54,426 copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-03-28T19:30:54,427 copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-03-28T19:30:54,428 creating build/lib/deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:54,428 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:54,429 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:54,429 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:54,430 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:54,430 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:54,431 copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:54,432 creating build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,432 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,433 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,434 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,434 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,435 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,436 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,436 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,437 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,437 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,438 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,439 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,439 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,440 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,440 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,441 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,442 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,443 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,444 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,444 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,445 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,445 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,448 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,452 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,456 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,459 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,463 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,466 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,469 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,472 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2025-03-28T19:30:54,475 creating build/lib/deepspeed/ops/csrc/lamb 2025-03-28T19:30:54,477 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2025-03-28T19:30:54,479 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2025-03-28T19:30:54,483 creating build/lib/deepspeed/ops/csrc/lion 2025-03-28T19:30:54,484 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-03-28T19:30:54,487 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-03-28T19:30:54,490 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-03-28T19:30:54,493 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2025-03-28T19:30:54,497 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2025-03-28T19:30:54,500 creating build/lib/deepspeed/ops/csrc/quantization 2025-03-28T19:30:54,501 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-03-28T19:30:54,504 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-03-28T19:30:54,508 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2025-03-28T19:30:54,512 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-03-28T19:30:54,515 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-03-28T19:30:54,518 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-03-28T19:30:54,522 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-03-28T19:30:54,524 creating build/lib/deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:54,526 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:54,528 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:54,531 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:54,534 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:54,536 creating build/lib/deepspeed/ops/csrc/sparse_attention 2025-03-28T19:30:54,538 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2025-03-28T19:30:54,540 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2025-03-28T19:30:54,542 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-03-28T19:30:54,545 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-03-28T19:30:54,547 creating build/lib/deepspeed/ops/csrc/spatial/includes 2025-03-28T19:30:54,548 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2025-03-28T19:30:54,551 creating build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,552 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,555 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,558 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,561 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,564 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,567 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,571 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,574 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-03-28T19:30:54,577 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,579 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,581 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,584 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,587 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,590 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,593 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,597 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,599 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,602 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,605 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:54,609 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-03-28T19:30:54,610 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-03-28T19:30:54,613 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-03-28T19:30:54,616 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-03-28T19:30:54,619 creating build/lib/deepspeed/ops/csrc/utils 2025-03-28T19:30:54,620 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-03-28T19:30:54,622 creating build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-03-28T19:30:54,624 copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-03-28T19:30:54,627 creating build/lib/deepspeed/ops/csrc/xpu/adam 2025-03-28T19:30:54,628 copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-03-28T19:30:54,630 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-03-28T19:30:54,633 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-03-28T19:30:54,636 creating build/lib/deepspeed/ops/csrc/xpu/common 2025-03-28T19:30:54,637 copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common 2025-03-28T19:30:54,639 creating build/lib/deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:54,640 copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:54,642 copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:54,645 copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:54,647 copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:54,650 copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:54,652 creating build/lib/deepspeed/ops/csrc/xpu/packbits 2025-03-28T19:30:54,653 copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits 2025-03-28T19:30:54,656 creating build/lib/deepspeed/inference/v2/ragged/csrc 2025-03-28T19:30:54,657 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-03-28T19:30:54,659 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-03-28T19:30:54,661 creating build/lib/deepspeed/inference/v2/ragged/includes 2025-03-28T19:30:54,662 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2025-03-28T19:30:54,665 creating build/lib/deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:54,666 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:54,669 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:54,672 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:54,674 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:54,678 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:54,681 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-03-28T19:30:54,683 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-03-28T19:30:54,684 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-03-28T19:30:54,687 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-03-28T19:30:54,689 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-03-28T19:30:54,691 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-03-28T19:30:54,693 copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-03-28T19:30:54,695 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-03-28T19:30:54,696 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-03-28T19:30:54,699 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-03-28T19:30:54,701 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-03-28T19:30:54,703 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:54,706 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:54,709 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:54,711 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:54,714 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:54,716 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:54,718 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:54,722 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:54,724 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:54,726 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:54,729 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,730 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,733 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,736 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,738 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,740 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,743 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,746 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,748 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,751 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:54,754 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:54,756 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:54,759 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:54,761 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:54,764 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:54,766 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:54,768 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:54,771 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:54,774 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:54,777 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:54,779 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:54,781 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:54,784 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:54,786 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:54,789 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:54,791 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:54,793 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:54,796 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:54,799 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:54,801 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:54,803 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:54,805 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:54,808 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:54,810 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:54,812 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:54,815 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:54,817 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:54,820 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:54,822 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:54,825 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:54,827 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:54,829 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:54,832 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:54,835 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:54,837 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:54,840 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:54,843 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:54,845 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:54,848 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:54,850 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:54,852 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:54,854 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:54,857 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:54,860 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:54,862 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:54,866 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:54,869 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:54,929 running build_scripts 2025-03-28T19:30:54,929 creating build/scripts-3.11 2025-03-28T19:30:54,931 copying and adjusting bin/deepspeed -> build/scripts-3.11 2025-03-28T19:30:54,933 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2025-03-28T19:30:54,934 copying and adjusting bin/ds -> build/scripts-3.11 2025-03-28T19:30:54,936 copying bin/ds_ssh -> build/scripts-3.11 2025-03-28T19:30:54,938 copying and adjusting bin/ds_report -> build/scripts-3.11 2025-03-28T19:30:54,939 copying and adjusting bin/ds_bench -> build/scripts-3.11 2025-03-28T19:30:54,941 copying and adjusting bin/dsr -> build/scripts-3.11 2025-03-28T19:30:54,942 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2025-03-28T19:30:54,944 copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11 2025-03-28T19:30:54,946 copying and adjusting bin/ds_io -> build/scripts-3.11 2025-03-28T19:30:54,946 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2025-03-28T19:30:54,947 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2025-03-28T19:30:54,948 changing mode of build/scripts-3.11/ds from 644 to 755 2025-03-28T19:30:54,948 changing mode of build/scripts-3.11/ds_report from 644 to 755 2025-03-28T19:30:54,948 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2025-03-28T19:30:54,949 changing mode of build/scripts-3.11/dsr from 644 to 755 2025-03-28T19:30:54,949 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2025-03-28T19:30:54,950 changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755 2025-03-28T19:30:54,950 changing mode of build/scripts-3.11/ds_io from 644 to 755 2025-03-28T19:30:54,977 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-03-28T19:30:54,978 !! 2025-03-28T19:30:54,979 ******************************************************************************** 2025-03-28T19:30:54,979 Please avoid running ``setup.py`` directly. 2025-03-28T19:30:54,980 Instead, use pypa/build, pypa/installer or other 2025-03-28T19:30:54,980 standards-based tools. 2025-03-28T19:30:54,981 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-03-28T19:30:54,982 ******************************************************************************** 2025-03-28T19:30:54,983 !! 2025-03-28T19:30:54,983 self.initialize_options() 2025-03-28T19:30:55,006 installing to build/bdist.linux-armv7l/wheel 2025-03-28T19:30:55,007 running install 2025-03-28T19:30:55,030 running install_lib 2025-03-28T19:30:55,060 creating build/bdist.linux-armv7l/wheel 2025-03-28T19:30:55,063 creating build/bdist.linux-armv7l/wheel/deepspeed 2025-03-28T19:30:55,064 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2025-03-28T19:30:55,066 copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-03-28T19:30:55,068 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-03-28T19:30:55,071 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-03-28T19:30:55,073 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-03-28T19:30:55,076 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-03-28T19:30:55,078 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-03-28T19:30:55,081 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2025-03-28T19:30:55,083 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2025-03-28T19:30:55,084 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-03-28T19:30:55,087 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-03-28T19:30:55,090 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2025-03-28T19:30:55,091 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-03-28T19:30:55,094 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-03-28T19:30:55,097 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-03-28T19:30:55,099 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations 2025-03-28T19:30:55,102 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2025-03-28T19:30:55,104 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,106 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,108 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,109 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,112 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,114 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,116 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,117 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,119 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,121 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-03-28T19:30:55,124 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2025-03-28T19:30:55,125 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-03-28T19:30:55,128 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-03-28T19:30:55,130 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-03-28T19:30:55,132 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-03-28T19:30:55,134 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-03-28T19:30:55,136 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-03-28T19:30:55,139 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2025-03-28T19:30:55,140 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-03-28T19:30:55,144 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2025-03-28T19:30:55,145 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-03-28T19:30:55,147 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-03-28T19:30:55,149 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-03-28T19:30:55,152 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-03-28T19:30:55,154 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-03-28T19:30:55,156 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-03-28T19:30:55,159 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2025-03-28T19:30:55,161 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2025-03-28T19:30:55,163 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:55,164 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:55,166 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:55,168 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:55,170 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-03-28T19:30:55,173 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:55,174 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:55,176 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:55,178 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:55,180 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-03-28T19:30:55,182 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:55,184 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:55,186 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:55,188 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:55,190 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-03-28T19:30:55,192 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:55,194 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:55,196 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:55,198 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:55,200 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-03-28T19:30:55,202 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-03-28T19:30:55,205 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,207 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,209 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,212 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,214 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,216 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,218 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,220 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,222 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,224 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-03-28T19:30:55,226 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-03-28T19:30:55,230 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-03-28T19:30:55,233 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-03-28T19:30:55,236 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:55,238 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:55,241 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:55,244 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:55,246 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-03-28T19:30:55,250 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:55,251 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:55,254 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:55,256 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:55,259 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-03-28T19:30:55,262 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:55,264 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:55,266 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:55,269 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:55,272 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-03-28T19:30:55,275 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:55,276 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:55,279 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:55,282 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:55,284 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-03-28T19:30:55,288 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,290 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,292 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,294 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,297 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,300 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,302 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,305 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,308 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,310 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-03-28T19:30:55,313 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-03-28T19:30:55,316 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-03-28T19:30:55,319 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:55,321 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:55,324 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:55,326 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:55,328 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-03-28T19:30:55,330 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:55,332 copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:55,334 copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:55,336 copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:55,338 copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-03-28T19:30:55,341 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-03-28T19:30:55,343 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,345 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,348 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2025-03-28T19:30:55,349 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-03-28T19:30:55,352 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-03-28T19:30:55,354 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-03-28T19:30:55,356 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-03-28T19:30:55,358 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,360 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,362 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,364 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,366 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,368 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,371 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2025-03-28T19:30:55,372 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-03-28T19:30:55,374 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-03-28T19:30:55,376 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-03-28T19:30:55,379 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2025-03-28T19:30:55,380 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes 2025-03-28T19:30:55,383 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2025-03-28T19:30:55,384 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-03-28T19:30:55,386 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-03-28T19:30:55,388 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-03-28T19:30:55,390 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-03-28T19:30:55,392 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-03-28T19:30:55,394 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-03-28T19:30:55,397 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2025-03-28T19:30:55,399 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:55,401 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:55,404 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:55,406 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:55,409 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:55,411 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-03-28T19:30:55,413 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2025-03-28T19:30:55,414 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-03-28T19:30:55,417 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:55,418 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:55,421 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:55,423 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:55,425 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:55,427 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:55,429 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-03-28T19:30:55,431 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-03-28T19:30:55,432 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-03-28T19:30:55,435 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:55,437 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:55,439 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:55,441 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:55,443 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:55,445 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-03-28T19:30:55,448 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-03-28T19:30:55,450 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2025-03-28T19:30:55,452 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:55,454 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:55,456 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:55,458 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:55,461 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:55,463 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,464 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,467 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,470 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,472 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,474 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,476 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,478 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,481 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,483 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-03-28T19:30:55,485 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:55,488 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-03-28T19:30:55,491 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:55,492 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:55,494 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:55,497 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:55,499 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:55,501 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:55,503 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:55,505 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-03-28T19:30:55,508 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:55,509 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:55,512 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:55,514 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:55,516 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:55,519 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-03-28T19:30:55,521 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,522 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,525 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,527 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,529 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,531 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,533 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,535 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,537 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-03-28T19:30:55,540 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:55,541 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:55,543 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:55,545 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:55,547 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:55,549 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-03-28T19:30:55,552 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:55,554 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:55,556 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:55,559 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:55,561 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-03-28T19:30:55,563 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-03-28T19:30:55,565 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-03-28T19:30:55,567 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2025-03-28T19:30:55,568 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-03-28T19:30:55,571 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:55,572 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:55,574 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:55,576 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:55,578 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:55,580 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:55,582 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-03-28T19:30:55,584 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-03-28T19:30:55,586 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes 2025-03-28T19:30:55,588 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:55,589 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:55,591 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:55,593 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:55,595 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:55,597 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:55,599 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-03-28T19:30:55,601 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:55,603 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:55,605 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:55,606 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:55,608 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-03-28T19:30:55,610 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:55,612 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:55,614 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:55,616 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:55,617 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:55,620 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:55,622 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-03-28T19:30:55,624 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,625 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,628 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,630 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,632 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,634 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,636 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,638 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,640 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-03-28T19:30:55,644 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:55,645 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:55,648 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:55,650 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:55,652 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:55,655 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:55,658 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-03-28T19:30:55,661 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:55,662 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:55,664 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:55,666 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:55,668 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:55,669 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:55,671 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-03-28T19:30:55,674 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:55,675 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:55,677 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:55,679 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:55,681 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:55,683 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:55,685 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-03-28T19:30:55,686 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-03-28T19:30:55,689 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-03-28T19:30:55,690 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-03-28T19:30:55,693 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-03-28T19:30:55,694 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-03-28T19:30:55,696 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-03-28T19:30:55,698 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-03-28T19:30:55,700 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2025-03-28T19:30:55,702 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-03-28T19:30:55,704 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-03-28T19:30:55,706 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2025-03-28T19:30:55,708 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-03-28T19:30:55,710 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-03-28T19:30:55,712 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-03-28T19:30:55,714 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-03-28T19:30:55,716 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-03-28T19:30:55,718 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-03-28T19:30:55,720 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-03-28T19:30:55,722 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,723 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,725 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,727 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,729 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,731 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,733 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,735 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,737 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-03-28T19:30:55,739 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2025-03-28T19:30:55,741 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2025-03-28T19:30:55,742 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-03-28T19:30:55,745 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-03-28T19:30:55,747 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-03-28T19:30:55,749 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2025-03-28T19:30:55,751 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-03-28T19:30:55,753 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-03-28T19:30:55,755 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2025-03-28T19:30:55,757 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-03-28T19:30:55,759 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-03-28T19:30:55,761 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2025-03-28T19:30:55,762 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-03-28T19:30:55,765 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-03-28T19:30:55,768 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2025-03-28T19:30:55,769 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-03-28T19:30:55,771 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-03-28T19:30:55,773 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations 2025-03-28T19:30:55,776 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2025-03-28T19:30:55,777 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-03-28T19:30:55,780 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-03-28T19:30:55,783 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2025-03-28T19:30:55,785 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-03-28T19:30:55,787 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-03-28T19:30:55,790 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-03-28T19:30:55,792 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-03-28T19:30:55,794 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-03-28T19:30:55,796 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-03-28T19:30:55,799 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-03-28T19:30:55,801 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2025-03-28T19:30:55,803 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,812 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,814 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,817 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,820 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,823 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,825 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,828 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,830 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,832 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-03-28T19:30:55,836 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2025-03-28T19:30:55,838 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino 2025-03-28T19:30:55,839 copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-03-28T19:30:55,842 copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-03-28T19:30:55,844 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,847 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2025-03-28T19:30:55,849 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-03-28T19:30:55,852 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-03-28T19:30:55,854 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-03-28T19:30:55,857 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,861 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2025-03-28T19:30:55,862 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,864 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,870 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,872 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,876 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,878 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,882 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,885 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,887 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,889 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,891 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,894 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,897 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,899 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,902 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,904 copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,906 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-03-28T19:30:55,909 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,911 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,913 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,916 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,922 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,925 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2025-03-28T19:30:55,926 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-03-28T19:30:55,928 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-03-28T19:30:55,931 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2025-03-28T19:30:55,932 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-03-28T19:30:55,935 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:55,937 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:55,939 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:55,941 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:55,943 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:55,945 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-03-28T19:30:55,947 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-03-28T19:30:55,949 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-03-28T19:30:55,952 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-03-28T19:30:55,954 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:55,956 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:55,960 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:55,962 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:55,964 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:55,967 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:55,969 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-03-28T19:30:55,972 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,975 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,977 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,980 copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,982 copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,984 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:55,987 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2025-03-28T19:30:55,988 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-03-28T19:30:55,991 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-03-28T19:30:55,993 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-03-28T19:30:55,997 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2025-03-28T19:30:55,998 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-03-28T19:30:56,001 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-03-28T19:30:56,003 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-03-28T19:30:56,005 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-03-28T19:30:56,007 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-03-28T19:30:56,009 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2025-03-28T19:30:56,010 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-03-28T19:30:56,013 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-03-28T19:30:56,016 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-03-28T19:30:56,020 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-03-28T19:30:56,022 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-03-28T19:30:56,024 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-03-28T19:30:56,027 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:56,028 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:56,030 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:56,032 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:56,034 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-03-28T19:30:56,036 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:56,040 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:56,044 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,046 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,049 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,052 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,055 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,057 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,060 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,063 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,067 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,069 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-03-28T19:30:56,074 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2025-03-28T19:30:56,075 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-03-28T19:30:56,078 copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-03-28T19:30:56,081 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-03-28T19:30:56,084 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-03-28T19:30:56,086 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-03-28T19:30:56,089 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-03-28T19:30:56,091 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:56,094 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:56,097 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-03-28T19:30:56,100 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel 2025-03-28T19:30:56,102 copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-03-28T19:30:56,105 copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-03-28T19:30:56,107 copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-03-28T19:30:56,110 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2025-03-28T19:30:56,112 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-03-28T19:30:56,114 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-03-28T19:30:56,116 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-03-28T19:30:56,119 creating build/bdist.linux-armv7l/wheel/deepspeed/linear 2025-03-28T19:30:56,121 copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-03-28T19:30:56,124 copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-03-28T19:30:56,126 copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-03-28T19:30:56,129 copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-03-28T19:30:56,132 copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-03-28T19:30:56,134 creating build/bdist.linux-armv7l/wheel/deepspeed/nvme 2025-03-28T19:30:56,135 copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,137 copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,140 copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,142 copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,144 copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,145 copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,148 copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,150 copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,152 copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,154 copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,156 copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,157 copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-03-28T19:30:56,161 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2025-03-28T19:30:56,162 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2025-03-28T19:30:56,164 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-03-28T19:30:56,166 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-03-28T19:30:56,168 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-03-28T19:30:56,170 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-03-28T19:30:56,172 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-03-28T19:30:56,173 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-03-28T19:30:56,175 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-03-28T19:30:56,178 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2025-03-28T19:30:56,179 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-03-28T19:30:56,181 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-03-28T19:30:56,183 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-03-28T19:30:56,184 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-03-28T19:30:56,186 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-03-28T19:30:56,189 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-03-28T19:30:56,191 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-03-28T19:30:56,193 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-03-28T19:30:56,196 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-03-28T19:30:56,198 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-03-28T19:30:56,201 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2025-03-28T19:30:56,202 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-03-28T19:30:56,205 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-03-28T19:30:56,208 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-03-28T19:30:56,210 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-03-28T19:30:56,212 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-03-28T19:30:56,215 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-03-28T19:30:56,217 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-03-28T19:30:56,219 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-03-28T19:30:56,222 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2025-03-28T19:30:56,224 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2025-03-28T19:30:56,225 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-03-28T19:30:56,227 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-03-28T19:30:56,230 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-03-28T19:30:56,232 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-03-28T19:30:56,234 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-03-28T19:30:56,236 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2025-03-28T19:30:56,237 copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,239 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,242 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,244 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,246 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,248 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,250 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,253 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,255 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,257 copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,259 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,262 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,264 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,266 copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,268 copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,270 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,272 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,274 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-03-28T19:30:56,277 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2025-03-28T19:30:56,279 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2025-03-28T19:30:56,280 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-03-28T19:30:56,282 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-03-28T19:30:56,285 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2025-03-28T19:30:56,286 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-03-28T19:30:56,289 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-03-28T19:30:56,291 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-03-28T19:30:56,293 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-03-28T19:30:56,297 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-03-28T19:30:56,299 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-03-28T19:30:56,302 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-03-28T19:30:56,305 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:56,306 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:56,309 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:56,311 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:56,313 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-03-28T19:30:56,317 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2025-03-28T19:30:56,318 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,322 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,324 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,327 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,330 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu 2025-03-28T19:30:56,331 copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-03-28T19:30:56,333 copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-03-28T19:30:56,336 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-03-28T19:30:56,338 copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-03-28T19:30:56,341 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-03-28T19:30:56,343 copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-03-28T19:30:56,345 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,348 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:56,350 copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:56,353 copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:56,355 copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:56,357 copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:56,360 copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-03-28T19:30:56,363 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2025-03-28T19:30:56,365 copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-03-28T19:30:56,367 copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-03-28T19:30:56,369 copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-03-28T19:30:56,372 copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-03-28T19:30:56,374 copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-03-28T19:30:56,376 copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-03-28T19:30:56,378 copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-03-28T19:30:56,381 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,383 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,385 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,388 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,390 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,392 copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,395 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,396 copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,480 copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,481 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,496 copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,767 copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,771 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,776 copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,781 copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,786 copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,790 copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-03-28T19:30:56,795 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,797 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,801 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,804 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,811 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,824 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,840 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,845 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,858 copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,873 copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-03-28T19:30:56,893 copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,914 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,934 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,945 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,952 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:56,980 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2025-03-28T19:30:56,987 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-03-28T19:30:57,007 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-03-28T19:30:57,023 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-03-28T19:30:57,037 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-03-28T19:30:57,046 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-03-28T19:30:57,064 copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-03-28T19:30:57,069 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-03-28T19:30:57,084 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:57,093 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:57,102 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:57,110 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:57,122 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:57,126 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:57,141 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:57,145 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-03-28T19:30:57,170 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2025-03-28T19:30:57,173 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-03-28T19:30:57,177 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-03-28T19:30:57,188 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2025-03-28T19:30:57,194 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio 2025-03-28T19:30:57,214 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2025-03-28T19:30:57,220 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2025-03-28T19:30:57,233 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:57,240 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:57,245 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:57,277 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-03-28T19:30:57,284 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-03-28T19:30:57,307 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-03-28T19:30:57,327 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:57,352 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:57,360 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:57,363 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:57,387 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:57,395 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:57,400 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:57,405 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:57,423 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:57,432 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-03-28T19:30:57,445 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:57,458 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:57,461 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:57,468 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:57,482 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:57,487 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-03-28T19:30:57,495 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:57,497 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:57,516 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:57,522 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:57,537 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:57,554 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:57,562 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:57,568 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-03-28T19:30:57,573 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-03-28T19:30:57,579 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2025-03-28T19:30:57,585 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention 2025-03-28T19:30:57,593 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2025-03-28T19:30:57,600 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,611 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,617 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,623 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,627 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,630 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,635 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,641 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,650 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,654 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,665 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,674 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,677 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,682 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,685 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,692 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,701 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,707 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,711 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,715 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,718 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,722 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,729 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,733 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,736 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,744 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,748 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,750 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,755 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-03-28T19:30:57,760 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2025-03-28T19:30:57,768 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2025-03-28T19:30:57,770 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes 2025-03-28T19:30:57,776 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2025-03-28T19:30:57,785 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-03-28T19:30:57,799 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-03-28T19:30:57,808 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2025-03-28T19:30:57,815 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,817 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,823 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,829 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,833 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,837 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,841 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,844 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,848 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,852 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,856 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,859 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,878 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,882 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,885 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,889 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,893 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,896 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-03-28T19:30:57,901 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2025-03-28T19:30:57,909 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test 2025-03-28T19:30:57,920 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2025-03-28T19:30:57,925 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-03-28T19:30:58,081 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-03-28T19:30:58,117 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-03-28T19:30:58,146 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-03-28T19:30:58,186 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-03-28T19:30:58,198 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-03-28T19:30:58,220 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2025-03-28T19:30:58,224 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-03-28T19:30:58,240 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-03-28T19:30:58,274 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-03-28T19:30:58,282 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-03-28T19:30:58,305 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-03-28T19:30:58,318 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-03-28T19:30:58,347 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-03-28T19:30:58,356 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2025-03-28T19:30:58,359 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-03-28T19:30:58,373 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu 2025-03-28T19:30:58,377 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits 2025-03-28T19:30:58,382 copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits 2025-03-28T19:30:58,392 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:58,395 copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:58,405 copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:58,411 copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:58,419 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:58,429 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-03-28T19:30:58,439 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2025-03-28T19:30:58,441 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-03-28T19:30:58,447 copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-03-28T19:30:58,451 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-03-28T19:30:58,459 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2025-03-28T19:30:58,461 copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad 2025-03-28T19:30:58,470 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2025-03-28T19:30:58,472 copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common 2025-03-28T19:30:58,480 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2025-03-28T19:30:58,485 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-03-28T19:30:58,494 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-03-28T19:30:58,504 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-03-28T19:30:58,511 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-03-28T19:30:58,515 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-03-28T19:30:58,521 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2025-03-28T19:30:58,524 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2025-03-28T19:30:58,527 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam 2025-03-28T19:30:58,534 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:58,536 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:58,542 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:58,550 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:58,560 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-03-28T19:30:58,570 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2025-03-28T19:30:58,575 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion 2025-03-28T19:30:58,581 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2025-03-28T19:30:58,585 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2025-03-28T19:30:58,588 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-03-28T19:30:58,597 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-03-28T19:30:58,601 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-03-28T19:30:58,613 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-03-28T19:30:58,619 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2025-03-28T19:30:58,624 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad 2025-03-28T19:30:58,636 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2025-03-28T19:30:58,640 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-03-28T19:30:58,647 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-03-28T19:30:58,660 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds 2025-03-28T19:30:58,664 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:58,667 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:58,674 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:58,680 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:58,692 copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:58,700 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:58,705 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-03-28T19:30:58,714 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2025-03-28T19:30:58,717 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-03-28T19:30:58,727 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-03-28T19:30:58,733 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-03-28T19:30:58,738 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-03-28T19:30:58,742 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-03-28T19:30:58,752 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,756 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,766 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,775 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2025-03-28T19:30:58,782 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2025-03-28T19:30:58,788 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-03-28T19:30:58,796 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-03-28T19:30:58,804 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-03-28T19:30:58,822 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,826 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,835 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,848 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,852 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,871 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,880 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,887 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,892 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,898 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,902 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-03-28T19:30:58,914 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,921 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,926 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,932 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,944 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,984 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-03-28T19:30:58,990 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:58,992 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:58,996 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:59,000 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:59,004 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-03-28T19:30:59,016 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2025-03-28T19:30:59,028 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-03-28T19:30:59,035 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-03-28T19:30:59,040 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-03-28T19:30:59,046 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-03-28T19:30:59,056 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2025-03-28T19:30:59,061 copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-03-28T19:30:59,066 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-03-28T19:30:59,100 copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-03-28T19:30:59,104 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-03-28T19:30:59,109 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2025-03-28T19:30:59,111 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-03-28T19:30:59,117 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-03-28T19:30:59,122 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2025-03-28T19:30:59,125 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-03-28T19:30:59,130 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-03-28T19:30:59,133 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops 2025-03-28T19:30:59,138 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds 2025-03-28T19:30:59,141 copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds 2025-03-28T19:30:59,149 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2025-03-28T19:30:59,151 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-03-28T19:30:59,155 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-03-28T19:30:59,161 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-03-28T19:30:59,165 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-03-28T19:30:59,169 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2025-03-28T19:30:59,172 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-03-28T19:30:59,178 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2025-03-28T19:30:59,180 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,183 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,187 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,197 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,202 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,204 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,208 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,212 copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,215 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,219 copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,223 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,226 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,230 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,233 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,238 copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,243 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,253 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,256 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,259 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,263 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,266 copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,269 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,273 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,283 copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,288 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,291 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,294 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,297 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-03-28T19:30:59,304 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,341 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,344 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,348 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,352 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,357 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,360 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,365 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,369 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,373 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,376 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,382 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-03-28T19:30:59,389 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,394 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,398 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,405 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,409 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-03-28T19:30:59,413 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-03-28T19:30:59,418 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2025-03-28T19:30:59,420 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-03-28T19:30:59,427 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-03-28T19:30:59,432 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2025-03-28T19:30:59,434 copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-03-28T19:30:59,441 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-03-28T19:30:59,451 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-03-28T19:30:59,455 copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-03-28T19:30:59,461 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2025-03-28T19:30:59,464 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-03-28T19:30:59,468 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-03-28T19:30:59,472 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-03-28T19:31:00,152 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-03-28T19:31:00,160 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-03-28T19:31:00,165 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-03-28T19:31:00,170 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-03-28T19:31:00,179 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2025-03-28T19:31:00,184 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe 2025-03-28T19:31:00,192 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2025-03-28T19:31:00,195 copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,201 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,207 copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,216 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,221 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,229 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,234 copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,239 copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,244 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,247 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,251 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-03-28T19:31:00,256 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2025-03-28T19:31:00,258 copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-03-28T19:31:00,265 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-03-28T19:31:00,271 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-03-28T19:31:00,281 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-03-28T19:31:00,284 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-03-28T19:31:00,288 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-03-28T19:31:00,291 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-03-28T19:31:00,299 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-03-28T19:31:00,308 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-03-28T19:31:00,315 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2025-03-28T19:31:00,317 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,334 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,338 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,341 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,344 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,355 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,358 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,362 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,366 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-03-28T19:31:00,370 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-03-28T19:31:00,374 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-03-28T19:31:00,379 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2025-03-28T19:31:00,381 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,396 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2025-03-28T19:31:00,398 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,407 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,411 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,416 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,420 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,424 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,431 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,435 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,439 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,445 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,449 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,454 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,462 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,466 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,474 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,481 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2025-03-28T19:31:00,483 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-03-28T19:31:00,489 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-03-28T19:31:00,497 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-03-28T19:31:00,501 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-03-28T19:31:00,506 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-03-28T19:31:00,511 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-03-28T19:31:00,516 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-03-28T19:31:00,520 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,523 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,528 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,531 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-03-28T19:31:00,536 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,539 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,546 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,551 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,554 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,559 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,568 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,571 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,577 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,581 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,585 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,605 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-03-28T19:31:00,610 running install_egg_info 2025-03-28T19:31:00,675 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.5-py3.11.egg-info 2025-03-28T19:31:00,703 running install_scripts 2025-03-28T19:31:00,705 creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,710 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,713 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,720 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,730 copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,732 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,739 copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,743 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,746 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,750 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,752 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts 2025-03-28T19:31:00,764 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/ds_ssh to 755 2025-03-28T19:31:00,764 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/ds to 755 2025-03-28T19:31:00,765 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/ds_report to 755 2025-03-28T19:31:00,765 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/ds_nvme_tune to 755 2025-03-28T19:31:00,767 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/dsr to 755 2025-03-28T19:31:00,769 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/ds_io to 755 2025-03-28T19:31:00,769 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/ds_bench to 755 2025-03-28T19:31:00,770 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/ds_elastic to 755 2025-03-28T19:31:00,770 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/deepspeed to 755 2025-03-28T19:31:00,771 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.data/scripts/deepspeed.pt to 755 2025-03-28T19:31:00,834 creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.5.dist-info/WHEEL 2025-03-28T19:31:00,839 creating '/tmp/pip-wheel-5y0j1qq1/deepspeed-0.16.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-03-28T19:31:00,843 adding 'deepspeed/__init__.py' 2025-03-28T19:31:00,845 adding 'deepspeed/constants.py' 2025-03-28T19:31:00,847 adding 'deepspeed/env_report.py' 2025-03-28T19:31:00,849 adding 'deepspeed/git_version_info.py' 2025-03-28T19:31:00,851 adding 'deepspeed/git_version_info_installed.py' 2025-03-28T19:31:00,854 adding 'deepspeed/accelerator/__init__.py' 2025-03-28T19:31:00,856 adding 'deepspeed/accelerator/abstract_accelerator.py' 2025-03-28T19:31:00,858 adding 'deepspeed/accelerator/cpu_accelerator.py' 2025-03-28T19:31:00,862 adding 'deepspeed/accelerator/cuda_accelerator.py' 2025-03-28T19:31:00,864 adding 'deepspeed/accelerator/hpu_accelerator.py' 2025-03-28T19:31:00,866 adding 'deepspeed/accelerator/mlu_accelerator.py' 2025-03-28T19:31:00,870 adding 'deepspeed/accelerator/mps_accelerator.py' 2025-03-28T19:31:00,871 adding 'deepspeed/accelerator/npu_accelerator.py' 2025-03-28T19:31:00,874 adding 'deepspeed/accelerator/real_accelerator.py' 2025-03-28T19:31:00,876 adding 'deepspeed/accelerator/sdaa_accelerator.py' 2025-03-28T19:31:00,878 adding 'deepspeed/accelerator/xpu_accelerator.py' 2025-03-28T19:31:00,881 adding 'deepspeed/autotuning/__init__.py' 2025-03-28T19:31:00,887 adding 'deepspeed/autotuning/autotuner.py' 2025-03-28T19:31:00,889 adding 'deepspeed/autotuning/config.py' 2025-03-28T19:31:00,893 adding 'deepspeed/autotuning/constants.py' 2025-03-28T19:31:00,901 adding 'deepspeed/autotuning/scheduler.py' 2025-03-28T19:31:00,903 adding 'deepspeed/autotuning/utils.py' 2025-03-28T19:31:00,914 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2025-03-28T19:31:00,917 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2025-03-28T19:31:00,919 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2025-03-28T19:31:00,921 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2025-03-28T19:31:00,923 adding 'deepspeed/autotuning/tuner/__init__.py' 2025-03-28T19:31:00,925 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2025-03-28T19:31:00,926 adding 'deepspeed/autotuning/tuner/cost_model.py' 2025-03-28T19:31:00,928 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2025-03-28T19:31:00,930 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2025-03-28T19:31:00,931 adding 'deepspeed/autotuning/tuner/utils.py' 2025-03-28T19:31:00,934 adding 'deepspeed/checkpoint/__init__.py' 2025-03-28T19:31:00,936 adding 'deepspeed/checkpoint/constants.py' 2025-03-28T19:31:00,938 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2025-03-28T19:31:00,942 adding 'deepspeed/checkpoint/ds_to_universal.py' 2025-03-28T19:31:00,944 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2025-03-28T19:31:00,946 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2025-03-28T19:31:00,948 adding 'deepspeed/checkpoint/reshape_utils.py' 2025-03-28T19:31:00,952 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2025-03-28T19:31:00,954 adding 'deepspeed/checkpoint/utils.py' 2025-03-28T19:31:00,955 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2025-03-28T19:31:00,958 adding 'deepspeed/comm/__init__.py' 2025-03-28T19:31:00,961 adding 'deepspeed/comm/backend.py' 2025-03-28T19:31:00,963 adding 'deepspeed/comm/ccl.py' 2025-03-28T19:31:00,967 adding 'deepspeed/comm/comm.py' 2025-03-28T19:31:00,970 adding 'deepspeed/comm/config.py' 2025-03-28T19:31:00,972 adding 'deepspeed/comm/constants.py' 2025-03-28T19:31:00,974 adding 'deepspeed/comm/reduce_op.py' 2025-03-28T19:31:00,978 adding 'deepspeed/comm/torch.py' 2025-03-28T19:31:00,980 adding 'deepspeed/comm/utils.py' 2025-03-28T19:31:00,983 adding 'deepspeed/compression/__init__.py' 2025-03-28T19:31:00,987 adding 'deepspeed/compression/basic_layer.py' 2025-03-28T19:31:00,989 adding 'deepspeed/compression/compress.py' 2025-03-28T19:31:00,993 adding 'deepspeed/compression/config.py' 2025-03-28T19:31:00,995 adding 'deepspeed/compression/constants.py' 2025-03-28T19:31:00,999 adding 'deepspeed/compression/helper.py' 2025-03-28T19:31:01,001 adding 'deepspeed/compression/scheduler.py' 2025-03-28T19:31:01,003 adding 'deepspeed/compression/utils.py' 2025-03-28T19:31:01,007 adding 'deepspeed/elasticity/__init__.py' 2025-03-28T19:31:01,010 adding 'deepspeed/elasticity/config.py' 2025-03-28T19:31:01,016 adding 'deepspeed/elasticity/constants.py' 2025-03-28T19:31:01,019 adding 'deepspeed/elasticity/elastic_agent.py' 2025-03-28T19:31:01,022 adding 'deepspeed/elasticity/elasticity.py' 2025-03-28T19:31:01,025 adding 'deepspeed/elasticity/utils.py' 2025-03-28T19:31:01,029 adding 'deepspeed/inference/__init__.py' 2025-03-28T19:31:01,034 adding 'deepspeed/inference/config.py' 2025-03-28T19:31:01,041 adding 'deepspeed/inference/engine.py' 2025-03-28T19:31:01,047 adding 'deepspeed/inference/quantization/__init__.py' 2025-03-28T19:31:01,049 adding 'deepspeed/inference/quantization/layers.py' 2025-03-28T19:31:01,051 adding 'deepspeed/inference/quantization/quantization.py' 2025-03-28T19:31:01,056 adding 'deepspeed/inference/quantization/quantization_context.py' 2025-03-28T19:31:01,058 adding 'deepspeed/inference/quantization/utils.py' 2025-03-28T19:31:01,060 adding 'deepspeed/inference/v2/__init__.py' 2025-03-28T19:31:01,063 adding 'deepspeed/inference/v2/allocator.py' 2025-03-28T19:31:01,065 adding 'deepspeed/inference/v2/config_v2.py' 2025-03-28T19:31:01,067 adding 'deepspeed/inference/v2/engine_factory.py' 2025-03-28T19:31:01,069 adding 'deepspeed/inference/v2/engine_v2.py' 2025-03-28T19:31:01,072 adding 'deepspeed/inference/v2/inference_parameter.py' 2025-03-28T19:31:01,075 adding 'deepspeed/inference/v2/inference_utils.py' 2025-03-28T19:31:01,076 adding 'deepspeed/inference/v2/logging.py' 2025-03-28T19:31:01,078 adding 'deepspeed/inference/v2/scheduling_utils.py' 2025-03-28T19:31:01,082 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2025-03-28T19:31:01,084 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2025-03-28T19:31:01,086 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2025-03-28T19:31:01,088 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2025-03-28T19:31:01,093 adding 'deepspeed/inference/v2/kernels/__init__.py' 2025-03-28T19:31:01,095 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2025-03-28T19:31:01,099 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2025-03-28T19:31:01,100 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2025-03-28T19:31:01,104 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2025-03-28T19:31:01,105 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2025-03-28T19:31:01,107 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2025-03-28T19:31:01,109 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2025-03-28T19:31:01,111 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu' 2025-03-28T19:31:01,114 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2025-03-28T19:31:01,124 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2025-03-28T19:31:01,126 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2025-03-28T19:31:01,128 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2025-03-28T19:31:01,131 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2025-03-28T19:31:01,133 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2025-03-28T19:31:01,134 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2025-03-28T19:31:01,136 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2025-03-28T19:31:01,137 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2025-03-28T19:31:01,139 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2025-03-28T19:31:01,140 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2025-03-28T19:31:01,143 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu' 2025-03-28T19:31:01,147 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py' 2025-03-28T19:31:01,148 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py' 2025-03-28T19:31:01,151 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp' 2025-03-28T19:31:01,152 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h' 2025-03-28T19:31:01,156 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu' 2025-03-28T19:31:01,158 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h' 2025-03-28T19:31:01,162 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h' 2025-03-28T19:31:01,164 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh' 2025-03-28T19:31:01,166 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh' 2025-03-28T19:31:01,168 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh' 2025-03-28T19:31:01,170 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh' 2025-03-28T19:31:01,173 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh' 2025-03-28T19:31:01,174 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh' 2025-03-28T19:31:01,178 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh' 2025-03-28T19:31:01,180 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h' 2025-03-28T19:31:01,182 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2025-03-28T19:31:01,184 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2025-03-28T19:31:01,186 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2025-03-28T19:31:01,197 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2025-03-28T19:31:01,199 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2025-03-28T19:31:01,201 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu' 2025-03-28T19:31:01,203 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2025-03-28T19:31:01,205 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2025-03-28T19:31:01,207 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2025-03-28T19:31:01,208 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2025-03-28T19:31:01,211 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2025-03-28T19:31:01,213 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu' 2025-03-28T19:31:01,216 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2025-03-28T19:31:01,217 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2025-03-28T19:31:01,219 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2025-03-28T19:31:01,221 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2025-03-28T19:31:01,223 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2025-03-28T19:31:01,224 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2025-03-28T19:31:01,226 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2025-03-28T19:31:01,228 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2025-03-28T19:31:01,230 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2025-03-28T19:31:01,231 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2025-03-28T19:31:01,233 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2025-03-28T19:31:01,234 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2025-03-28T19:31:01,235 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2025-03-28T19:31:01,237 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2025-03-28T19:31:01,239 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2025-03-28T19:31:01,241 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2025-03-28T19:31:01,243 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2025-03-28T19:31:01,246 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2025-03-28T19:31:01,249 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2025-03-28T19:31:01,251 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2025-03-28T19:31:01,252 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2025-03-28T19:31:01,254 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2025-03-28T19:31:01,257 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2025-03-28T19:31:01,259 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2025-03-28T19:31:01,260 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2025-03-28T19:31:01,263 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2025-03-28T19:31:01,264 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2025-03-28T19:31:01,266 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2025-03-28T19:31:01,267 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2025-03-28T19:31:01,269 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2025-03-28T19:31:01,271 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2025-03-28T19:31:01,273 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2025-03-28T19:31:01,275 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2025-03-28T19:31:01,276 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2025-03-28T19:31:01,277 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2025-03-28T19:31:01,279 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2025-03-28T19:31:01,281 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu' 2025-03-28T19:31:01,283 adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h' 2025-03-28T19:31:01,289 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2025-03-28T19:31:01,291 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2025-03-28T19:31:01,292 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2025-03-28T19:31:01,294 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2025-03-28T19:31:01,296 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2025-03-28T19:31:01,298 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu' 2025-03-28T19:31:01,300 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2025-03-28T19:31:01,302 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2025-03-28T19:31:01,304 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2025-03-28T19:31:01,306 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2025-03-28T19:31:01,307 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2025-03-28T19:31:01,309 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2025-03-28T19:31:01,311 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2025-03-28T19:31:01,315 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu' 2025-03-28T19:31:01,318 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2025-03-28T19:31:01,320 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2025-03-28T19:31:01,322 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2025-03-28T19:31:01,323 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2025-03-28T19:31:01,324 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2025-03-28T19:31:01,326 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu' 2025-03-28T19:31:01,328 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2025-03-28T19:31:01,330 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2025-03-28T19:31:01,332 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2025-03-28T19:31:01,333 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2025-03-28T19:31:01,335 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2025-03-28T19:31:01,337 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu' 2025-03-28T19:31:01,339 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2025-03-28T19:31:01,341 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2025-03-28T19:31:01,343 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2025-03-28T19:31:01,345 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py' 2025-03-28T19:31:01,347 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp' 2025-03-28T19:31:01,349 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh' 2025-03-28T19:31:01,351 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h' 2025-03-28T19:31:01,353 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py' 2025-03-28T19:31:01,354 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu' 2025-03-28T19:31:01,357 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2025-03-28T19:31:01,359 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2025-03-28T19:31:01,361 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2025-03-28T19:31:01,363 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2025-03-28T19:31:01,366 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2025-03-28T19:31:01,368 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2025-03-28T19:31:01,371 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2025-03-28T19:31:01,373 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2025-03-28T19:31:01,375 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2025-03-28T19:31:01,376 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2025-03-28T19:31:01,378 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2025-03-28T19:31:01,380 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2025-03-28T19:31:01,381 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2025-03-28T19:31:01,383 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2025-03-28T19:31:01,385 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2025-03-28T19:31:01,386 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2025-03-28T19:31:01,388 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2025-03-28T19:31:01,390 adding 'deepspeed/inference/v2/model_implementations/falcon/container.py' 2025-03-28T19:31:01,392 adding 'deepspeed/inference/v2/model_implementations/falcon/model.py' 2025-03-28T19:31:01,393 adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py' 2025-03-28T19:31:01,396 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2025-03-28T19:31:01,397 adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py' 2025-03-28T19:31:01,399 adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py' 2025-03-28T19:31:01,401 adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py' 2025-03-28T19:31:01,402 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2025-03-28T19:31:01,404 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2025-03-28T19:31:01,406 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2025-03-28T19:31:01,408 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2025-03-28T19:31:01,410 adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py' 2025-03-28T19:31:01,411 adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py' 2025-03-28T19:31:01,414 adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py' 2025-03-28T19:31:01,415 adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py' 2025-03-28T19:31:01,417 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2025-03-28T19:31:01,419 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2025-03-28T19:31:01,422 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2025-03-28T19:31:01,424 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2025-03-28T19:31:01,426 adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py' 2025-03-28T19:31:01,429 adding 'deepspeed/inference/v2/model_implementations/phi/containers.py' 2025-03-28T19:31:01,431 adding 'deepspeed/inference/v2/model_implementations/phi/model.py' 2025-03-28T19:31:01,433 adding 'deepspeed/inference/v2/model_implementations/phi/policy.py' 2025-03-28T19:31:01,435 adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py' 2025-03-28T19:31:01,437 adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py' 2025-03-28T19:31:01,440 adding 'deepspeed/inference/v2/model_implementations/phi3/model.py' 2025-03-28T19:31:01,442 adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py' 2025-03-28T19:31:01,444 adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py' 2025-03-28T19:31:01,446 adding 'deepspeed/inference/v2/model_implementations/qwen/container.py' 2025-03-28T19:31:01,448 adding 'deepspeed/inference/v2/model_implementations/qwen/model.py' 2025-03-28T19:31:01,450 adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py' 2025-03-28T19:31:01,453 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py' 2025-03-28T19:31:01,455 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py' 2025-03-28T19:31:01,457 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py' 2025-03-28T19:31:01,459 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py' 2025-03-28T19:31:01,461 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py' 2025-03-28T19:31:01,463 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py' 2025-03-28T19:31:01,466 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py' 2025-03-28T19:31:01,468 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py' 2025-03-28T19:31:01,471 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2025-03-28T19:31:01,473 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2025-03-28T19:31:01,476 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2025-03-28T19:31:01,478 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2025-03-28T19:31:01,480 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2025-03-28T19:31:01,482 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2025-03-28T19:31:01,484 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2025-03-28T19:31:01,486 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2025-03-28T19:31:01,488 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2025-03-28T19:31:01,491 adding 'deepspeed/inference/v2/modules/__init__.py' 2025-03-28T19:31:01,493 adding 'deepspeed/inference/v2/modules/ds_module.py' 2025-03-28T19:31:01,495 adding 'deepspeed/inference/v2/modules/heuristics.py' 2025-03-28T19:31:01,497 adding 'deepspeed/inference/v2/modules/module_registry.py' 2025-03-28T19:31:01,500 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2025-03-28T19:31:01,502 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2025-03-28T19:31:01,504 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2025-03-28T19:31:01,506 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2025-03-28T19:31:01,507 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2025-03-28T19:31:01,510 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2025-03-28T19:31:01,511 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2025-03-28T19:31:01,514 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2025-03-28T19:31:01,516 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2025-03-28T19:31:01,519 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2025-03-28T19:31:01,521 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2025-03-28T19:31:01,523 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2025-03-28T19:31:01,525 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2025-03-28T19:31:01,527 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2025-03-28T19:31:01,528 adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py' 2025-03-28T19:31:01,530 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2025-03-28T19:31:01,532 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2025-03-28T19:31:01,534 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2025-03-28T19:31:01,536 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2025-03-28T19:31:01,538 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2025-03-28T19:31:01,539 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2025-03-28T19:31:01,541 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2025-03-28T19:31:01,543 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2025-03-28T19:31:01,544 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2025-03-28T19:31:01,546 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2025-03-28T19:31:01,548 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2025-03-28T19:31:01,550 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2025-03-28T19:31:01,552 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2025-03-28T19:31:01,554 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2025-03-28T19:31:01,556 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2025-03-28T19:31:01,557 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2025-03-28T19:31:01,558 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2025-03-28T19:31:01,561 adding 'deepspeed/inference/v2/ragged/__init__.py' 2025-03-28T19:31:01,563 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2025-03-28T19:31:01,565 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2025-03-28T19:31:01,567 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2025-03-28T19:31:01,569 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2025-03-28T19:31:01,571 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2025-03-28T19:31:01,573 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2025-03-28T19:31:01,576 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2025-03-28T19:31:01,577 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2025-03-28T19:31:01,579 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2025-03-28T19:31:01,581 adding 'deepspeed/launcher/__init__.py' 2025-03-28T19:31:01,582 adding 'deepspeed/launcher/constants.py' 2025-03-28T19:31:01,584 adding 'deepspeed/launcher/launch.py' 2025-03-28T19:31:01,586 adding 'deepspeed/launcher/launcher_helper.py' 2025-03-28T19:31:01,588 adding 'deepspeed/launcher/multinode_runner.py' 2025-03-28T19:31:01,592 adding 'deepspeed/launcher/runner.py' 2025-03-28T19:31:01,594 adding 'deepspeed/linear/__init__.py' 2025-03-28T19:31:01,595 adding 'deepspeed/linear/config.py' 2025-03-28T19:31:01,597 adding 'deepspeed/linear/context_manager.py' 2025-03-28T19:31:01,599 adding 'deepspeed/linear/optimized_linear.py' 2025-03-28T19:31:01,600 adding 'deepspeed/linear/quantization.py' 2025-03-28T19:31:01,602 adding 'deepspeed/model_implementations/__init__.py' 2025-03-28T19:31:01,605 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2025-03-28T19:31:01,606 adding 'deepspeed/model_implementations/diffusers/unet.py' 2025-03-28T19:31:01,608 adding 'deepspeed/model_implementations/diffusers/vae.py' 2025-03-28T19:31:01,610 adding 'deepspeed/model_implementations/features/__init__.py' 2025-03-28T19:31:01,612 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2025-03-28T19:31:01,614 adding 'deepspeed/model_implementations/transformers/__init__.py' 2025-03-28T19:31:01,615 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2025-03-28T19:31:01,616 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2025-03-28T19:31:01,618 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2025-03-28T19:31:01,619 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2025-03-28T19:31:01,620 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2025-03-28T19:31:01,622 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2025-03-28T19:31:01,623 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2025-03-28T19:31:01,624 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2025-03-28T19:31:01,626 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2025-03-28T19:31:01,628 adding 'deepspeed/module_inject/__init__.py' 2025-03-28T19:31:01,631 adding 'deepspeed/module_inject/auto_tp.py' 2025-03-28T19:31:01,633 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2025-03-28T19:31:01,635 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2025-03-28T19:31:01,636 adding 'deepspeed/module_inject/inject.py' 2025-03-28T19:31:01,640 adding 'deepspeed/module_inject/layers.py' 2025-03-28T19:31:01,642 adding 'deepspeed/module_inject/load_checkpoint.py' 2025-03-28T19:31:01,644 adding 'deepspeed/module_inject/module_quantize.py' 2025-03-28T19:31:01,646 adding 'deepspeed/module_inject/policy.py' 2025-03-28T19:31:01,650 adding 'deepspeed/module_inject/replace_module.py' 2025-03-28T19:31:01,651 adding 'deepspeed/module_inject/replace_policy.py' 2025-03-28T19:31:01,653 adding 'deepspeed/module_inject/tp_shard.py' 2025-03-28T19:31:01,654 adding 'deepspeed/module_inject/utils.py' 2025-03-28T19:31:01,656 adding 'deepspeed/module_inject/containers/__init__.py' 2025-03-28T19:31:01,659 adding 'deepspeed/module_inject/containers/base.py' 2025-03-28T19:31:01,660 adding 'deepspeed/module_inject/containers/base_moe.py' 2025-03-28T19:31:01,662 adding 'deepspeed/module_inject/containers/bert.py' 2025-03-28T19:31:01,663 adding 'deepspeed/module_inject/containers/bloom.py' 2025-03-28T19:31:01,665 adding 'deepspeed/module_inject/containers/clip.py' 2025-03-28T19:31:01,668 adding 'deepspeed/module_inject/containers/distil_bert.py' 2025-03-28T19:31:01,669 adding 'deepspeed/module_inject/containers/gpt2.py' 2025-03-28T19:31:01,671 adding 'deepspeed/module_inject/containers/gptj.py' 2025-03-28T19:31:01,673 adding 'deepspeed/module_inject/containers/gptneo.py' 2025-03-28T19:31:01,674 adding 'deepspeed/module_inject/containers/gptneox.py' 2025-03-28T19:31:01,676 adding 'deepspeed/module_inject/containers/internlm.py' 2025-03-28T19:31:01,679 adding 'deepspeed/module_inject/containers/llama.py' 2025-03-28T19:31:01,681 adding 'deepspeed/module_inject/containers/llama2.py' 2025-03-28T19:31:01,682 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2025-03-28T19:31:01,684 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2025-03-28T19:31:01,686 adding 'deepspeed/module_inject/containers/opt.py' 2025-03-28T19:31:01,687 adding 'deepspeed/module_inject/containers/unet.py' 2025-03-28T19:31:01,689 adding 'deepspeed/module_inject/containers/vae.py' 2025-03-28T19:31:01,691 adding 'deepspeed/module_inject/containers/features/__init__.py' 2025-03-28T19:31:01,693 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2025-03-28T19:31:01,695 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2025-03-28T19:31:01,697 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2025-03-28T19:31:01,698 adding 'deepspeed/module_inject/containers/features/megatron.py' 2025-03-28T19:31:01,700 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2025-03-28T19:31:01,701 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2025-03-28T19:31:01,703 adding 'deepspeed/moe/__init__.py' 2025-03-28T19:31:01,705 adding 'deepspeed/moe/experts.py' 2025-03-28T19:31:01,706 adding 'deepspeed/moe/layer.py' 2025-03-28T19:31:01,708 adding 'deepspeed/moe/mappings.py' 2025-03-28T19:31:01,711 adding 'deepspeed/moe/sharded_moe.py' 2025-03-28T19:31:01,713 adding 'deepspeed/moe/utils.py' 2025-03-28T19:31:01,715 adding 'deepspeed/monitor/__init__.py' 2025-03-28T19:31:01,716 adding 'deepspeed/monitor/comet.py' 2025-03-28T19:31:01,718 adding 'deepspeed/monitor/config.py' 2025-03-28T19:31:01,719 adding 'deepspeed/monitor/csv_monitor.py' 2025-03-28T19:31:01,720 adding 'deepspeed/monitor/monitor.py' 2025-03-28T19:31:01,722 adding 'deepspeed/monitor/tensorboard.py' 2025-03-28T19:31:01,723 adding 'deepspeed/monitor/utils.py' 2025-03-28T19:31:01,725 adding 'deepspeed/monitor/wandb.py' 2025-03-28T19:31:01,727 adding 'deepspeed/nebula/__init__.py' 2025-03-28T19:31:01,728 adding 'deepspeed/nebula/config.py' 2025-03-28T19:31:01,730 adding 'deepspeed/nebula/constants.py' 2025-03-28T19:31:01,732 adding 'deepspeed/nvme/__init__.py' 2025-03-28T19:31:01,734 adding 'deepspeed/nvme/ds_aio_args.py' 2025-03-28T19:31:01,735 adding 'deepspeed/nvme/ds_aio_basic.py' 2025-03-28T19:31:01,738 adding 'deepspeed/nvme/ds_aio_handle.py' 2025-03-28T19:31:01,739 adding 'deepspeed/nvme/ds_aio_job.py' 2025-03-28T19:31:01,741 adding 'deepspeed/nvme/parse_nvme_stats.py' 2025-03-28T19:31:01,742 adding 'deepspeed/nvme/perf_generate_param.py' 2025-03-28T19:31:01,747 adding 'deepspeed/nvme/perf_run_sweep.py' 2025-03-28T19:31:01,749 adding 'deepspeed/nvme/perf_sweep_utils.py' 2025-03-28T19:31:01,750 adding 'deepspeed/nvme/test_ds_aio.py' 2025-03-28T19:31:01,752 adding 'deepspeed/nvme/test_ds_aio_utils.py' 2025-03-28T19:31:01,753 adding 'deepspeed/nvme/validate_async_io.py' 2025-03-28T19:31:01,755 adding 'deepspeed/ops/__init__.py' 2025-03-28T19:31:01,757 adding 'deepspeed/ops/adagrad/__init__.py' 2025-03-28T19:31:01,759 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2025-03-28T19:31:01,761 adding 'deepspeed/ops/adam/__init__.py' 2025-03-28T19:31:01,763 adding 'deepspeed/ops/adam/cpu_adam.py' 2025-03-28T19:31:01,766 adding 'deepspeed/ops/adam/fused_adam.py' 2025-03-28T19:31:01,767 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2025-03-28T19:31:01,770 adding 'deepspeed/ops/aio/__init__.py' 2025-03-28T19:31:01,774 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2025-03-28T19:31:01,776 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2025-03-28T19:31:01,778 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2025-03-28T19:31:01,779 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2025-03-28T19:31:01,781 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2025-03-28T19:31:01,783 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2025-03-28T19:31:01,786 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2025-03-28T19:31:01,787 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2025-03-28T19:31:01,796 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2025-03-28T19:31:01,797 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2025-03-28T19:31:01,799 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2025-03-28T19:31:01,800 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2025-03-28T19:31:01,803 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp' 2025-03-28T19:31:01,805 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h' 2025-03-28T19:31:01,806 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2025-03-28T19:31:01,807 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2025-03-28T19:31:01,810 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp' 2025-03-28T19:31:01,811 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h' 2025-03-28T19:31:01,813 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2025-03-28T19:31:01,814 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2025-03-28T19:31:01,815 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2025-03-28T19:31:01,817 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2025-03-28T19:31:01,818 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2025-03-28T19:31:01,819 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2025-03-28T19:31:01,829 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2025-03-28T19:31:01,830 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2025-03-28T19:31:01,832 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp' 2025-03-28T19:31:01,834 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h' 2025-03-28T19:31:01,835 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2025-03-28T19:31:01,837 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2025-03-28T19:31:01,840 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2025-03-28T19:31:01,843 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2025-03-28T19:31:01,846 adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp' 2025-03-28T19:31:01,847 adding 'deepspeed/ops/csrc/cpu/comm/shm.h' 2025-03-28T19:31:01,849 adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp' 2025-03-28T19:31:01,851 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2025-03-28T19:31:01,854 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2025-03-28T19:31:01,856 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2025-03-28T19:31:01,857 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2025-03-28T19:31:01,859 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2025-03-28T19:31:01,868 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2025-03-28T19:31:02,092 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2025-03-28T19:31:02,095 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2025-03-28T19:31:02,098 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2025-03-28T19:31:02,101 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2025-03-28T19:31:02,103 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2025-03-28T19:31:02,106 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2025-03-28T19:31:02,108 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2025-03-28T19:31:02,111 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2025-03-28T19:31:02,114 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2025-03-28T19:31:02,116 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2025-03-28T19:31:02,118 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2025-03-28T19:31:02,126 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2025-03-28T19:31:02,130 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2025-03-28T19:31:02,132 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2025-03-28T19:31:02,137 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2025-03-28T19:31:02,141 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2025-03-28T19:31:02,145 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2025-03-28T19:31:02,147 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2025-03-28T19:31:02,149 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2025-03-28T19:31:02,152 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2025-03-28T19:31:02,153 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2025-03-28T19:31:02,156 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp' 2025-03-28T19:31:02,159 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu' 2025-03-28T19:31:02,161 adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h' 2025-03-28T19:31:02,163 adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h' 2025-03-28T19:31:02,167 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp' 2025-03-28T19:31:02,168 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h' 2025-03-28T19:31:02,170 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h' 2025-03-28T19:31:02,171 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp' 2025-03-28T19:31:02,173 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h' 2025-03-28T19:31:02,174 adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp' 2025-03-28T19:31:02,180 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2025-03-28T19:31:02,182 adding 'deepspeed/ops/csrc/includes/Timer.h' 2025-03-28T19:31:02,183 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2025-03-28T19:31:02,185 adding 'deepspeed/ops/csrc/includes/compat.h' 2025-03-28T19:31:02,187 adding 'deepspeed/ops/csrc/includes/context.h' 2025-03-28T19:31:02,189 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2025-03-28T19:31:02,190 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2025-03-28T19:31:02,192 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2025-03-28T19:31:02,194 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2025-03-28T19:31:02,195 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2025-03-28T19:31:02,197 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2025-03-28T19:31:02,199 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2025-03-28T19:31:02,201 adding 'deepspeed/ops/csrc/includes/dropout.h' 2025-03-28T19:31:02,202 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2025-03-28T19:31:02,204 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2025-03-28T19:31:02,206 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2025-03-28T19:31:02,207 adding 'deepspeed/ops/csrc/includes/gelu.h' 2025-03-28T19:31:02,209 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2025-03-28T19:31:02,211 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2025-03-28T19:31:02,213 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2025-03-28T19:31:02,215 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2025-03-28T19:31:02,217 adding 'deepspeed/ops/csrc/includes/quantization.h' 2025-03-28T19:31:02,219 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2025-03-28T19:31:02,221 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2025-03-28T19:31:02,225 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2025-03-28T19:31:02,228 adding 'deepspeed/ops/csrc/includes/simd.h' 2025-03-28T19:31:02,230 adding 'deepspeed/ops/csrc/includes/softmax.h' 2025-03-28T19:31:02,232 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2025-03-28T19:31:02,234 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2025-03-28T19:31:02,237 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2025-03-28T19:31:02,241 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2025-03-28T19:31:02,244 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2025-03-28T19:31:02,247 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2025-03-28T19:31:02,249 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2025-03-28T19:31:02,252 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2025-03-28T19:31:02,254 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2025-03-28T19:31:02,257 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2025-03-28T19:31:02,261 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2025-03-28T19:31:02,264 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2025-03-28T19:31:02,267 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2025-03-28T19:31:02,269 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2025-03-28T19:31:02,271 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2025-03-28T19:31:02,274 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2025-03-28T19:31:02,277 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2025-03-28T19:31:02,279 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2025-03-28T19:31:02,281 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2025-03-28T19:31:02,283 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2025-03-28T19:31:02,286 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2025-03-28T19:31:02,290 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2025-03-28T19:31:02,292 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2025-03-28T19:31:02,295 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2025-03-28T19:31:02,299 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2025-03-28T19:31:02,302 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2025-03-28T19:31:02,308 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2025-03-28T19:31:02,311 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2025-03-28T19:31:02,313 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2025-03-28T19:31:02,320 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2025-03-28T19:31:02,323 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2025-03-28T19:31:02,326 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2025-03-28T19:31:02,329 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2025-03-28T19:31:02,330 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2025-03-28T19:31:02,333 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2025-03-28T19:31:02,335 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2025-03-28T19:31:02,337 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2025-03-28T19:31:02,342 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2025-03-28T19:31:02,345 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2025-03-28T19:31:02,346 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2025-03-28T19:31:02,349 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2025-03-28T19:31:02,352 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2025-03-28T19:31:02,354 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2025-03-28T19:31:02,357 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2025-03-28T19:31:02,359 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2025-03-28T19:31:02,361 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2025-03-28T19:31:02,364 adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp' 2025-03-28T19:31:02,365 adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp' 2025-03-28T19:31:02,367 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp' 2025-03-28T19:31:02,369 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp' 2025-03-28T19:31:02,371 adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp' 2025-03-28T19:31:02,373 adding 'deepspeed/ops/csrc/xpu/includes/compat.h' 2025-03-28T19:31:02,375 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h' 2025-03-28T19:31:02,376 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h' 2025-03-28T19:31:02,378 adding 'deepspeed/ops/csrc/xpu/includes/simd.h' 2025-03-28T19:31:02,380 adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h' 2025-03-28T19:31:02,382 adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp' 2025-03-28T19:31:02,383 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2025-03-28T19:31:02,385 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2025-03-28T19:31:02,387 adding 'deepspeed/ops/fp_quantizer/__init__.py' 2025-03-28T19:31:02,388 adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py' 2025-03-28T19:31:02,390 adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py' 2025-03-28T19:31:02,392 adding 'deepspeed/ops/fp_quantizer/quantize.py' 2025-03-28T19:31:02,393 adding 'deepspeed/ops/gds/__init__.py' 2025-03-28T19:31:02,395 adding 'deepspeed/ops/lamb/__init__.py' 2025-03-28T19:31:02,397 adding 'deepspeed/ops/lamb/fused_lamb.py' 2025-03-28T19:31:02,398 adding 'deepspeed/ops/lion/__init__.py' 2025-03-28T19:31:02,400 adding 'deepspeed/ops/lion/cpu_lion.py' 2025-03-28T19:31:02,401 adding 'deepspeed/ops/lion/fused_lion.py' 2025-03-28T19:31:02,403 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2025-03-28T19:31:02,405 adding 'deepspeed/ops/op_builder/__init__.py' 2025-03-28T19:31:02,406 adding 'deepspeed/ops/op_builder/all_ops.py' 2025-03-28T19:31:02,408 adding 'deepspeed/ops/op_builder/async_io.py' 2025-03-28T19:31:02,412 adding 'deepspeed/ops/op_builder/builder.py' 2025-03-28T19:31:02,414 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2025-03-28T19:31:02,415 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2025-03-28T19:31:02,416 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2025-03-28T19:31:02,417 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2025-03-28T19:31:02,419 adding 'deepspeed/ops/op_builder/fp_quantizer.py' 2025-03-28T19:31:02,420 adding 'deepspeed/ops/op_builder/fused_adam.py' 2025-03-28T19:31:02,422 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2025-03-28T19:31:02,423 adding 'deepspeed/ops/op_builder/fused_lion.py' 2025-03-28T19:31:02,424 adding 'deepspeed/ops/op_builder/gds.py' 2025-03-28T19:31:02,426 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2025-03-28T19:31:02,427 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2025-03-28T19:31:02,429 adding 'deepspeed/ops/op_builder/quantizer.py' 2025-03-28T19:31:02,430 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2025-03-28T19:31:02,431 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2025-03-28T19:31:02,433 adding 'deepspeed/ops/op_builder/random_ltd.py' 2025-03-28T19:31:02,434 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2025-03-28T19:31:02,435 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2025-03-28T19:31:02,437 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2025-03-28T19:31:02,438 adding 'deepspeed/ops/op_builder/transformer.py' 2025-03-28T19:31:02,439 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2025-03-28T19:31:02,441 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2025-03-28T19:31:02,442 adding 'deepspeed/ops/op_builder/cpu/async_io.py' 2025-03-28T19:31:02,444 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2025-03-28T19:31:02,445 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2025-03-28T19:31:02,446 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2025-03-28T19:31:02,448 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2025-03-28T19:31:02,449 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2025-03-28T19:31:02,451 adding 'deepspeed/ops/op_builder/hpu/__init__.py' 2025-03-28T19:31:02,452 adding 'deepspeed/ops/op_builder/hpu/builder.py' 2025-03-28T19:31:02,453 adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py' 2025-03-28T19:31:02,455 adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py' 2025-03-28T19:31:02,457 adding 'deepspeed/ops/op_builder/hpu/fused_adam.py' 2025-03-28T19:31:02,458 adding 'deepspeed/ops/op_builder/hpu/no_impl.py' 2025-03-28T19:31:02,459 adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py' 2025-03-28T19:31:02,461 adding 'deepspeed/ops/op_builder/mlu/__init__.py' 2025-03-28T19:31:02,462 adding 'deepspeed/ops/op_builder/mlu/builder.py' 2025-03-28T19:31:02,463 adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py' 2025-03-28T19:31:02,465 adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py' 2025-03-28T19:31:02,466 adding 'deepspeed/ops/op_builder/mlu/fused_adam.py' 2025-03-28T19:31:02,468 adding 'deepspeed/ops/op_builder/mlu/no_impl.py' 2025-03-28T19:31:02,469 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2025-03-28T19:31:02,471 adding 'deepspeed/ops/op_builder/npu/async_io.py' 2025-03-28T19:31:02,472 adding 'deepspeed/ops/op_builder/npu/builder.py' 2025-03-28T19:31:02,474 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2025-03-28T19:31:02,475 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2025-03-28T19:31:02,476 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2025-03-28T19:31:02,477 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2025-03-28T19:31:02,479 adding 'deepspeed/ops/op_builder/npu/inference.py' 2025-03-28T19:31:02,480 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2025-03-28T19:31:02,482 adding 'deepspeed/ops/op_builder/sdaa/__init__.py' 2025-03-28T19:31:02,484 adding 'deepspeed/ops/op_builder/sdaa/builder.py' 2025-03-28T19:31:02,485 adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py' 2025-03-28T19:31:02,486 adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py' 2025-03-28T19:31:02,488 adding 'deepspeed/ops/op_builder/sdaa/no_impl.py' 2025-03-28T19:31:02,489 adding 'deepspeed/ops/op_builder/xpu/__init__.py' 2025-03-28T19:31:02,491 adding 'deepspeed/ops/op_builder/xpu/async_io.py' 2025-03-28T19:31:02,493 adding 'deepspeed/ops/op_builder/xpu/builder.py' 2025-03-28T19:31:02,494 adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py' 2025-03-28T19:31:02,495 adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py' 2025-03-28T19:31:02,497 adding 'deepspeed/ops/op_builder/xpu/flash_attn.py' 2025-03-28T19:31:02,498 adding 'deepspeed/ops/op_builder/xpu/fused_adam.py' 2025-03-28T19:31:02,499 adding 'deepspeed/ops/op_builder/xpu/inference.py' 2025-03-28T19:31:02,500 adding 'deepspeed/ops/op_builder/xpu/no_impl.py' 2025-03-28T19:31:02,501 adding 'deepspeed/ops/op_builder/xpu/packbits.py' 2025-03-28T19:31:02,503 adding 'deepspeed/ops/quantizer/__init__.py' 2025-03-28T19:31:02,504 adding 'deepspeed/ops/quantizer/quantizer.py' 2025-03-28T19:31:02,506 adding 'deepspeed/ops/random_ltd/__init__.py' 2025-03-28T19:31:02,508 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2025-03-28T19:31:02,510 adding 'deepspeed/ops/sparse_attention/__init__.py' 2025-03-28T19:31:02,511 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2025-03-28T19:31:02,515 adding 'deepspeed/ops/sparse_attention/matmul.py' 2025-03-28T19:31:02,517 adding 'deepspeed/ops/sparse_attention/softmax.py' 2025-03-28T19:31:02,519 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2025-03-28T19:31:02,521 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2025-03-28T19:31:02,524 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2025-03-28T19:31:02,526 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2025-03-28T19:31:02,528 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2025-03-28T19:31:02,529 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2025-03-28T19:31:02,531 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2025-03-28T19:31:02,533 adding 'deepspeed/ops/transformer/__init__.py' 2025-03-28T19:31:02,535 adding 'deepspeed/ops/transformer/transformer.py' 2025-03-28T19:31:02,537 adding 'deepspeed/ops/transformer/inference/__init__.py' 2025-03-28T19:31:02,539 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2025-03-28T19:31:02,541 adding 'deepspeed/ops/transformer/inference/config.py' 2025-03-28T19:31:02,542 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2025-03-28T19:31:02,544 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2025-03-28T19:31:02,545 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2025-03-28T19:31:02,548 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2025-03-28T19:31:02,549 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2025-03-28T19:31:02,552 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2025-03-28T19:31:02,553 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2025-03-28T19:31:02,555 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2025-03-28T19:31:02,556 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2025-03-28T19:31:02,557 adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py' 2025-03-28T19:31:02,559 adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py' 2025-03-28T19:31:02,560 adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py' 2025-03-28T19:31:02,561 adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py' 2025-03-28T19:31:02,563 adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py' 2025-03-28T19:31:02,564 adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py' 2025-03-28T19:31:02,565 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2025-03-28T19:31:02,567 adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py' 2025-03-28T19:31:02,568 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2025-03-28T19:31:02,569 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2025-03-28T19:31:02,571 adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py' 2025-03-28T19:31:02,572 adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py' 2025-03-28T19:31:02,573 adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py' 2025-03-28T19:31:02,575 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2025-03-28T19:31:02,576 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2025-03-28T19:31:02,577 adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py' 2025-03-28T19:31:02,579 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2025-03-28T19:31:02,580 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2025-03-28T19:31:02,581 adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py' 2025-03-28T19:31:02,583 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2025-03-28T19:31:02,585 adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py' 2025-03-28T19:31:02,587 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2025-03-28T19:31:02,590 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2025-03-28T19:31:02,591 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2025-03-28T19:31:02,593 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2025-03-28T19:31:02,595 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2025-03-28T19:31:02,597 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2025-03-28T19:31:02,598 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2025-03-28T19:31:02,600 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2025-03-28T19:31:02,601 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2025-03-28T19:31:02,603 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2025-03-28T19:31:02,605 adding 'deepspeed/pipe/__init__.py' 2025-03-28T19:31:02,607 adding 'deepspeed/profiling/__init__.py' 2025-03-28T19:31:02,608 adding 'deepspeed/profiling/config.py' 2025-03-28T19:31:02,610 adding 'deepspeed/profiling/constants.py' 2025-03-28T19:31:02,612 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2025-03-28T19:31:02,617 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2025-03-28T19:31:02,620 adding 'deepspeed/runtime/__init__.py' 2025-03-28T19:31:02,621 adding 'deepspeed/runtime/base_optimizer.py' 2025-03-28T19:31:02,624 adding 'deepspeed/runtime/bf16_optimizer.py' 2025-03-28T19:31:02,626 adding 'deepspeed/runtime/compiler.py' 2025-03-28T19:31:02,630 adding 'deepspeed/runtime/config.py' 2025-03-28T19:31:02,633 adding 'deepspeed/runtime/config_utils.py' 2025-03-28T19:31:02,635 adding 'deepspeed/runtime/constants.py' 2025-03-28T19:31:02,637 adding 'deepspeed/runtime/dataloader.py' 2025-03-28T19:31:02,638 adding 'deepspeed/runtime/eigenvalue.py' 2025-03-28T19:31:02,658 adding 'deepspeed/runtime/engine.py' 2025-03-28T19:31:02,662 adding 'deepspeed/runtime/hybrid_engine.py' 2025-03-28T19:31:02,666 adding 'deepspeed/runtime/lr_schedules.py' 2025-03-28T19:31:02,668 adding 'deepspeed/runtime/progressive_layer_drop.py' 2025-03-28T19:31:02,669 adding 'deepspeed/runtime/quantize.py' 2025-03-28T19:31:02,671 adding 'deepspeed/runtime/sparse_tensor.py' 2025-03-28T19:31:02,673 adding 'deepspeed/runtime/state_dict_factory.py' 2025-03-28T19:31:02,679 adding 'deepspeed/runtime/utils.py' 2025-03-28T19:31:02,681 adding 'deepspeed/runtime/weight_quantizer.py' 2025-03-28T19:31:02,683 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2025-03-28T19:31:02,689 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2025-03-28T19:31:02,691 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2025-03-28T19:31:02,693 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2025-03-28T19:31:02,694 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2025-03-28T19:31:02,696 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2025-03-28T19:31:02,745 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2025-03-28T19:31:02,747 adding 'deepspeed/runtime/comm/__init__.py' 2025-03-28T19:31:02,749 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2025-03-28T19:31:02,753 adding 'deepspeed/runtime/comm/compressed.py' 2025-03-28T19:31:02,755 adding 'deepspeed/runtime/comm/hccl.py' 2025-03-28T19:31:02,757 adding 'deepspeed/runtime/comm/mpi.py' 2025-03-28T19:31:02,759 adding 'deepspeed/runtime/comm/nccl.py' 2025-03-28T19:31:02,762 adding 'deepspeed/runtime/compression/__init__.py' 2025-03-28T19:31:02,763 adding 'deepspeed/runtime/compression/cupy.py' 2025-03-28T19:31:02,765 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2025-03-28T19:31:02,767 adding 'deepspeed/runtime/data_pipeline/config.py' 2025-03-28T19:31:02,863 adding 'deepspeed/runtime/data_pipeline/constants.py' 2025-03-28T19:31:02,878 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2025-03-28T19:31:02,881 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2025-03-28T19:31:02,902 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2025-03-28T19:31:02,904 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2025-03-28T19:31:03,043 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2025-03-28T19:31:03,046 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2025-03-28T19:31:03,316 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2025-03-28T19:31:03,343 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2025-03-28T19:31:03,350 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2025-03-28T19:31:03,374 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2025-03-28T19:31:03,381 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2025-03-28T19:31:03,800 adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py' 2025-03-28T19:31:04,270 adding 'deepspeed/runtime/domino/__init__.py' 2025-03-28T19:31:04,640 adding 'deepspeed/runtime/domino/transformer.py' 2025-03-28T19:31:04,756 adding 'deepspeed/runtime/fp16/__init__.py' 2025-03-28T19:31:04,764 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2025-03-28T19:31:04,769 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2025-03-28T19:31:04,775 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2025-03-28T19:31:04,779 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2025-03-28T19:31:04,784 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2025-03-28T19:31:04,792 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2025-03-28T19:31:04,798 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2025-03-28T19:31:04,802 adding 'deepspeed/runtime/pipe/__init__.py' 2025-03-28T19:31:04,818 adding 'deepspeed/runtime/pipe/engine.py' 2025-03-28T19:31:04,828 adding 'deepspeed/runtime/pipe/module.py' 2025-03-28T19:31:04,832 adding 'deepspeed/runtime/pipe/p2p.py' 2025-03-28T19:31:04,837 adding 'deepspeed/runtime/pipe/schedule.py' 2025-03-28T19:31:04,844 adding 'deepspeed/runtime/pipe/topology.py' 2025-03-28T19:31:04,848 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2025-03-28T19:31:04,850 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2025-03-28T19:31:04,854 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2025-03-28T19:31:04,857 adding 'deepspeed/runtime/swap_tensor/constants.py' 2025-03-28T19:31:04,861 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2025-03-28T19:31:04,863 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2025-03-28T19:31:04,866 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2025-03-28T19:31:04,869 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2025-03-28T19:31:04,871 adding 'deepspeed/runtime/swap_tensor/utils.py' 2025-03-28T19:31:04,873 adding 'deepspeed/runtime/tensor_parallel/__init__.py' 2025-03-28T19:31:04,875 adding 'deepspeed/runtime/tensor_parallel/config.py' 2025-03-28T19:31:04,877 adding 'deepspeed/runtime/tensor_parallel/tp_manager.py' 2025-03-28T19:31:04,880 adding 'deepspeed/runtime/zero/__init__.py' 2025-03-28T19:31:04,882 adding 'deepspeed/runtime/zero/config.py' 2025-03-28T19:31:04,884 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2025-03-28T19:31:04,886 adding 'deepspeed/runtime/zero/linear.py' 2025-03-28T19:31:04,889 adding 'deepspeed/runtime/zero/mics.py' 2025-03-28T19:31:04,892 adding 'deepspeed/runtime/zero/mics_utils.py' 2025-03-28T19:31:04,894 adding 'deepspeed/runtime/zero/offload_config.py' 2025-03-28T19:31:04,895 adding 'deepspeed/runtime/zero/offload_states.py' 2025-03-28T19:31:04,899 adding 'deepspeed/runtime/zero/parameter_offload.py' 2025-03-28T19:31:04,911 adding 'deepspeed/runtime/zero/partition_parameters.py' 2025-03-28T19:31:04,916 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2025-03-28T19:31:04,917 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2025-03-28T19:31:04,933 adding 'deepspeed/runtime/zero/stage3.py' 2025-03-28T19:31:04,948 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2025-03-28T19:31:04,950 adding 'deepspeed/runtime/zero/test.py' 2025-03-28T19:31:04,953 adding 'deepspeed/runtime/zero/tiling.py' 2025-03-28T19:31:04,955 adding 'deepspeed/runtime/zero/utils.py' 2025-03-28T19:31:04,957 adding 'deepspeed/sequence/__init__.py' 2025-03-28T19:31:04,959 adding 'deepspeed/sequence/cross_entropy.py' 2025-03-28T19:31:04,964 adding 'deepspeed/sequence/fpdt_layer.py' 2025-03-28T19:31:04,967 adding 'deepspeed/sequence/layer.py' 2025-03-28T19:31:04,970 adding 'deepspeed/utils/__init__.py' 2025-03-28T19:31:04,972 adding 'deepspeed/utils/bwc.py' 2025-03-28T19:31:04,974 adding 'deepspeed/utils/comms_logging.py' 2025-03-28T19:31:04,975 adding 'deepspeed/utils/config.py' 2025-03-28T19:31:04,977 adding 'deepspeed/utils/debug.py' 2025-03-28T19:31:04,978 adding 'deepspeed/utils/exceptions.py' 2025-03-28T19:31:04,982 adding 'deepspeed/utils/groups.py' 2025-03-28T19:31:04,983 adding 'deepspeed/utils/init_on_device.py' 2025-03-28T19:31:04,985 adding 'deepspeed/utils/logging.py' 2025-03-28T19:31:04,986 adding 'deepspeed/utils/mixed_precision_linkage.py' 2025-03-28T19:31:04,988 adding 'deepspeed/utils/numa.py' 2025-03-28T19:31:04,990 adding 'deepspeed/utils/nvtx.py' 2025-03-28T19:31:04,992 adding 'deepspeed/utils/tensor_fragment.py' 2025-03-28T19:31:04,994 adding 'deepspeed/utils/timer.py' 2025-03-28T19:31:04,995 adding 'deepspeed/utils/torch.py' 2025-03-28T19:31:04,997 adding 'deepspeed/utils/types.py' 2025-03-28T19:31:04,999 adding 'deepspeed/utils/z3_leaf_module.py' 2025-03-28T19:31:05,002 adding 'deepspeed/utils/zero_to_fp32.py' 2025-03-28T19:31:05,006 adding 'deepspeed-0.16.5.data/scripts/deepspeed' 2025-03-28T19:31:05,007 adding 'deepspeed-0.16.5.data/scripts/deepspeed.pt' 2025-03-28T19:31:05,008 adding 'deepspeed-0.16.5.data/scripts/ds' 2025-03-28T19:31:05,010 adding 'deepspeed-0.16.5.data/scripts/ds_bench' 2025-03-28T19:31:05,012 adding 'deepspeed-0.16.5.data/scripts/ds_elastic' 2025-03-28T19:31:05,013 adding 'deepspeed-0.16.5.data/scripts/ds_io' 2025-03-28T19:31:05,014 adding 'deepspeed-0.16.5.data/scripts/ds_nvme_tune' 2025-03-28T19:31:05,016 adding 'deepspeed-0.16.5.data/scripts/ds_report' 2025-03-28T19:31:05,018 adding 'deepspeed-0.16.5.data/scripts/ds_ssh' 2025-03-28T19:31:05,019 adding 'deepspeed-0.16.5.data/scripts/dsr' 2025-03-28T19:31:05,023 adding 'deepspeed-0.16.5.dist-info/LICENSE' 2025-03-28T19:31:05,028 adding 'deepspeed-0.16.5.dist-info/METADATA' 2025-03-28T19:31:05,030 adding 'deepspeed-0.16.5.dist-info/WHEEL' 2025-03-28T19:31:05,031 adding 'deepspeed-0.16.5.dist-info/entry_points.txt' 2025-03-28T19:31:05,032 adding 'deepspeed-0.16.5.dist-info/top_level.txt' 2025-03-28T19:31:05,047 adding 'deepspeed-0.16.5.dist-info/RECORD' 2025-03-28T19:31:05,100 removing build/bdist.linux-armv7l/wheel 2025-03-28T19:31:05,522 deepspeed build time = 27.96796202659607 secs 2025-03-28T19:31:05,680 Building wheel for deepspeed (setup.py): finished with status 'done' 2025-03-28T19:31:05,698 Created wheel for deepspeed: filename=deepspeed-0.16.5-py3-none-any.whl size=1580454 sha256=b65b62a7d371ef56c8cd0c38c09ad930ab3a2441eb27d9e7636dfea16d4bf6fc 2025-03-28T19:31:05,700 Stored in directory: /tmp/pip-ephem-wheel-cache-tazga4tz/wheels/52/cc/7a/2a649465930859b5b227a30f75d9d19895f1d52f0b071a7486 2025-03-28T19:31:05,745 Successfully built deepspeed 2025-03-28T19:31:05,792 Removed build tracker: '/tmp/pip-build-tracker-7ql5nv8v'