2025-01-21T23:19:27,402 Created temporary directory: /tmp/pip-build-tracker-flq6028s
2025-01-21T23:19:27,404 Initialized build tracking at /tmp/pip-build-tracker-flq6028s
2025-01-21T23:19:27,405 Created build tracker: /tmp/pip-build-tracker-flq6028s
2025-01-21T23:19:27,405 Entered build tracker: /tmp/pip-build-tracker-flq6028s
2025-01-21T23:19:27,406 Created temporary directory: /tmp/pip-wheel-s0rypxhd
2025-01-21T23:19:27,410 Created temporary directory: /tmp/pip-ephem-wheel-cache-brhv7glp
2025-01-21T23:19:27,456 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-01-21T23:19:27,459 2 location(s) to search for versions of deepspeed:
2025-01-21T23:19:27,459 * https://pypi.org/simple/deepspeed/
2025-01-21T23:19:27,459 * https://www.piwheels.org/simple/deepspeed/
2025-01-21T23:19:27,460 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-01-21T23:19:27,460 Getting page https://pypi.org/simple/deepspeed/
2025-01-21T23:19:27,462 Found index url https://pypi.org/simple/
2025-01-21T23:19:27,685 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-01-21T23:19:27,705   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-01-21T23:19:27,706   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-01-21T23:19:27,706   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-01-21T23:19:27,707   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-01-21T23:19:27,707   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-01-21T23:19:27,708   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-01-21T23:19:27,709   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-01-21T23:19:27,710   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-01-21T23:19:27,710   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-01-21T23:19:27,711   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-01-21T23:19:27,712   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-01-21T23:19:27,712   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-01-21T23:19:27,713   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-01-21T23:19:27,714   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-01-21T23:19:27,715   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-01-21T23:19:27,715   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-01-21T23:19:27,716   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-01-21T23:19:27,716   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-01-21T23:19:27,717   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-01-21T23:19:27,718   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-01-21T23:19:27,718   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-01-21T23:19:27,719   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-01-21T23:19:27,720   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-01-21T23:19:27,720   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-01-21T23:19:27,721   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-01-21T23:19:27,722   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-01-21T23:19:27,723   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-01-21T23:19:27,723   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-01-21T23:19:27,724   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-01-21T23:19:27,725   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-01-21T23:19:27,726   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-01-21T23:19:27,727   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-01-21T23:19:27,727   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-01-21T23:19:27,728   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-01-21T23:19:27,728   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-01-21T23:19:27,729   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-01-21T23:19:27,729   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-01-21T23:19:27,730   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-01-21T23:19:27,731   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-01-21T23:19:27,731   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-01-21T23:19:27,732   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-01-21T23:19:27,733   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-01-21T23:19:27,734   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-01-21T23:19:27,735   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-01-21T23:19:27,735   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-01-21T23:19:27,736   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-01-21T23:19:27,737   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-01-21T23:19:27,737   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-01-21T23:19:27,738   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-01-21T23:19:27,739   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-01-21T23:19:27,740   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-01-21T23:19:27,741   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-01-21T23:19:27,741   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-01-21T23:19:27,742   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-01-21T23:19:27,743   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-01-21T23:19:27,743   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-01-21T23:19:27,744   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-01-21T23:19:27,745   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-01-21T23:19:27,746   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-01-21T23:19:27,746   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-01-21T23:19:27,747   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-01-21T23:19:27,748   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-01-21T23:19:27,749   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-01-21T23:19:27,750   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-01-21T23:19:27,750   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-01-21T23:19:27,751   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-01-21T23:19:27,752   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-01-21T23:19:27,752   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-01-21T23:19:27,753   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-01-21T23:19:27,754   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-01-21T23:19:27,755   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-01-21T23:19:27,755   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-01-21T23:19:27,756   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-01-21T23:19:27,756   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-01-21T23:19:27,757   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-01-21T23:19:27,758   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-01-21T23:19:27,758   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-01-21T23:19:27,759   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-01-21T23:19:27,760   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-01-21T23:19:27,761   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-01-21T23:19:27,762   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-01-21T23:19:27,763   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-01-21T23:19:27,763   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-01-21T23:19:27,764   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-01-21T23:19:27,765   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-01-21T23:19:27,766   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-01-21T23:19:27,767   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-01-21T23:19:27,767   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-01-21T23:19:27,768   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-01-21T23:19:27,768   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-01-21T23:19:27,769   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-01-21T23:19:27,770   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-01-21T23:19:27,770   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-01-21T23:19:27,771   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-01-21T23:19:27,771   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-01-21T23:19:27,772   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-01-21T23:19:27,773   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-01-21T23:19:27,774   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-01-21T23:19:27,774   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-01-21T23:19:27,775   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-01-21T23:19:27,776   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-01-21T23:19:27,776   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-01-21T23:19:27,777   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-01-21T23:19:27,778   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-01-21T23:19:27,779   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-01-21T23:19:27,779   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-01-21T23:19:27,780   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-01-21T23:19:27,780   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-01-21T23:19:27,781 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-01-21T23:19:27,782 Getting page https://www.piwheels.org/simple/deepspeed/
2025-01-21T23:19:27,783 Found index url https://www.piwheels.org/simple/
2025-01-21T23:19:27,955 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2025-01-21T23:19:27,974   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,975   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,975   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,976   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,976   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,977   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,978   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,978   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,979   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,979   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,980   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,981   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,981   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,982   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,982   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,983   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,983   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,984   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,985   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,985   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,986   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,987   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,987   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,988   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,989   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,990   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,990   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,991   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,991   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,991   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,992   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,993   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,993   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,994   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,994   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,995   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,995   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,996   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,997   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,997   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,998   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,999   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:27,999   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,000   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,000   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,001   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,001   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,002   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,002   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,003   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,003   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,004   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,005   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,005   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,006   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,007   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,007   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,007   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,008   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,008   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,009   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,009   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,010   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,010   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,011   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,011   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,012   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,013   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,013   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,014   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,015   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,015   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,015   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,016   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,016   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2025-01-21T23:19:28,017 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-01-21T23:19:28,017 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-01-21T23:19:28,049 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-01-21T23:19:28,051 Collecting deepspeed==0.16.3
2025-01-21T23:19:28,054   Created temporary directory: /tmp/pip-unpack-w3mey1yj
2025-01-21T23:19:28,283   Downloading deepspeed-0.16.3.tar.gz (1.4 MB)
2025-01-21T23:19:30,746   Added deepspeed==0.16.3 from https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz to build tracker '/tmp/pip-build-tracker-flq6028s'
2025-01-21T23:19:30,748   Running setup.py (path:/tmp/pip-wheel-s0rypxhd/deepspeed_5dd85abf45c64b08a80d7308a7f48616/setup.py) egg_info for package deepspeed
2025-01-21T23:19:30,749   Created temporary directory: /tmp/pip-pip-egg-info-boixyyad
2025-01-21T23:19:30,749   Preparing metadata (setup.py): started
2025-01-21T23:19:30,751   Running command python setup.py egg_info
2025-01-21T23:19:31,734   fatal: not a git repository (or any of the parent directories): .git
2025-01-21T23:19:32,417   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-01-21T23:19:32,418    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-01-21T23:19:32,418   DS_BUILD_OPS=0
2025-01-21T23:19:32,419   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-01-21T23:19:32,420   version=0.16.3, git_hash=unknown, git_branch=unknown
2025-01-21T23:19:32,420   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-01-21T23:19:32,421   ext_modules=[]
2025-01-21T23:19:32,421   running egg_info
2025-01-21T23:19:32,446   creating /tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info
2025-01-21T23:19:32,447   writing /tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info/PKG-INFO
2025-01-21T23:19:32,480   writing dependency_links to /tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info/dependency_links.txt
2025-01-21T23:19:32,482   writing entry points to /tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info/entry_points.txt
2025-01-21T23:19:32,499   writing requirements to /tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info/requires.txt
2025-01-21T23:19:32,500   writing top-level names to /tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info/top_level.txt
2025-01-21T23:19:32,502   writing manifest file '/tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info/SOURCES.txt'
2025-01-21T23:19:32,741   reading manifest file '/tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info/SOURCES.txt'
2025-01-21T23:19:32,742   reading manifest template 'MANIFEST.in'
2025-01-21T23:19:32,745   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-01-21T23:19:32,745   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-01-21T23:19:34,306   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-01-21T23:19:35,275   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-01-21T23:19:35,941   warning: no files found matching '*.tr' under directory 'csrc'
2025-01-21T23:19:36,077   warning: no files found matching '*.cc' under directory 'csrc'
2025-01-21T23:19:36,120   warning: no files found matching '*.py' under directory 'benchmarks'
2025-01-21T23:19:36,126   adding license file 'LICENSE'
2025-01-21T23:19:36,165   writing manifest file '/tmp/pip-pip-egg-info-boixyyad/deepspeed.egg-info/SOURCES.txt'
2025-01-21T23:19:36,168   deepspeed build time = 4.429813861846924 secs
2025-01-21T23:19:36,286   Preparing metadata (setup.py): finished with status 'done'
2025-01-21T23:19:36,292   Source in /tmp/pip-wheel-s0rypxhd/deepspeed_5dd85abf45c64b08a80d7308a7f48616 has version 0.16.3, which satisfies requirement deepspeed==0.16.3 from https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz
2025-01-21T23:19:36,293   Removed deepspeed==0.16.3 from https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz from build tracker '/tmp/pip-build-tracker-flq6028s'
2025-01-21T23:19:36,365 Created temporary directory: /tmp/pip-unpack-9ll5h5_l
2025-01-21T23:19:36,366 Created temporary directory: /tmp/pip-unpack-afosvjy3
2025-01-21T23:19:36,367 Building wheels for collected packages: deepspeed
2025-01-21T23:19:36,371   Created temporary directory: /tmp/pip-wheel-9e84u6r2
2025-01-21T23:19:36,371   Building wheel for deepspeed (setup.py): started
2025-01-21T23:19:36,373   Destination directory: /tmp/pip-wheel-9e84u6r2
2025-01-21T23:19:36,373   Running command python setup.py bdist_wheel
2025-01-21T23:19:36,873   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-01-21T23:19:36,877    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-01-21T23:19:36,998   DS_BUILD_OPS=0
2025-01-21T23:19:37,114   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-01-21T23:19:37,133   fatal: not a git repository (or any of the parent directories): .git
2025-01-21T23:19:37,134   version=0.16.3, git_hash=unknown, git_branch=unknown
2025-01-21T23:19:37,135   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-01-21T23:19:37,135   ext_modules=[]
2025-01-21T23:19:37,725   running bdist_wheel
2025-01-21T23:19:37,853   running build
2025-01-21T23:19:37,854   running build_py
2025-01-21T23:19:37,883   creating build/lib/deepspeed
2025-01-21T23:19:37,885   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-01-21T23:19:37,887   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-01-21T23:19:37,889   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-01-21T23:19:37,891   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-01-21T23:19:37,894   copying deepspeed/constants.py -> build/lib/deepspeed
2025-01-21T23:19:37,896   creating build/lib/deepspeed/nebula
2025-01-21T23:19:37,897   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-01-21T23:19:37,899   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-01-21T23:19:37,901   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-01-21T23:19:37,903   creating build/lib/deepspeed/elasticity
2025-01-21T23:19:37,904   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-01-21T23:19:37,906   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-01-21T23:19:37,908   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-01-21T23:19:37,911   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-01-21T23:19:37,913   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-01-21T23:19:37,915   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-01-21T23:19:37,917   creating build/lib/deepspeed/comm
2025-01-21T23:19:37,918   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,920   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,922   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,924   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,926   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,929   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,931   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,933   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,935   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-01-21T23:19:37,937   creating build/lib/deepspeed/sequence
2025-01-21T23:19:37,938   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-01-21T23:19:37,941   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-01-21T23:19:37,944   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-01-21T23:19:37,946   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-01-21T23:19:37,949   creating build/lib/deepspeed/monitor
2025-01-21T23:19:37,950   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-01-21T23:19:37,952   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-01-21T23:19:37,954   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-01-21T23:19:37,956   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-01-21T23:19:37,958   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-01-21T23:19:37,959   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-01-21T23:19:37,961   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-01-21T23:19:37,963   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-01-21T23:19:37,966   creating build/lib/deepspeed/compression
2025-01-21T23:19:37,967   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-01-21T23:19:37,969   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-01-21T23:19:37,972   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-01-21T23:19:37,975   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-01-21T23:19:37,978   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-01-21T23:19:37,980   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-01-21T23:19:37,982   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-01-21T23:19:37,984   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-01-21T23:19:37,987   creating build/lib/deepspeed/runtime
2025-01-21T23:19:37,988   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:37,991   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:37,996   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:37,999   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,001   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,003   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,006   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,007   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,010   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,012   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,015   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,016   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,019   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,021   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,023   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,025   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,027   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,029   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-01-21T23:19:38,032   creating build/lib/deepspeed/utils
2025-01-21T23:19:38,033   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,036   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,037   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,040   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,042   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,044   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,047   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,049   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,051   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,053   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,055   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,057   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,060   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,063   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,065   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,067   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,070   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,072   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-01-21T23:19:38,075   creating build/lib/deepspeed/model_implementations
2025-01-21T23:19:38,076   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-01-21T23:19:38,079   creating build/lib/deepspeed/linear
2025-01-21T23:19:38,081   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-01-21T23:19:38,083   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-01-21T23:19:38,086   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-01-21T23:19:38,088   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-01-21T23:19:38,090   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-01-21T23:19:38,093   creating build/lib/deepspeed/autotuning
2025-01-21T23:19:38,094   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-01-21T23:19:38,097   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-01-21T23:19:38,099   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-01-21T23:19:38,102   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-01-21T23:19:38,105   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-01-21T23:19:38,107   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-01-21T23:19:38,110   creating build/lib/deepspeed/ops
2025-01-21T23:19:38,111   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-01-21T23:19:38,114   creating build/lib/deepspeed/moe
2025-01-21T23:19:38,116   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-01-21T23:19:38,118   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-01-21T23:19:38,121   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-01-21T23:19:38,123   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-01-21T23:19:38,126   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-01-21T23:19:38,128   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-01-21T23:19:38,130   creating build/lib/deepspeed/accelerator
2025-01-21T23:19:38,132   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,135   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,137   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,140   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,142   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,145   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,147   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,150   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,152   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,155   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-01-21T23:19:38,158   creating build/lib/deepspeed/module_inject
2025-01-21T23:19:38,159   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,162   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,166   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,171   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,175   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,180   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,183   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,186   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,191   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,193   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,196   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,199   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,200   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-01-21T23:19:38,203   creating build/lib/deepspeed/nvme
2025-01-21T23:19:38,204   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,206   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,209   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,210   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,212   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,214   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,216   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,218   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,220   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,222   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,224   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,226   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-01-21T23:19:38,228   creating build/lib/deepspeed/inference
2025-01-21T23:19:38,229   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-01-21T23:19:38,232   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-01-21T23:19:38,235   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-01-21T23:19:38,237   creating build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,238   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,240   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,243   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,245   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,248   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,250   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,252   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,255   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,257   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,258   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-01-21T23:19:38,261   creating build/lib/deepspeed/launcher
2025-01-21T23:19:38,262   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-01-21T23:19:38,264   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-01-21T23:19:38,267   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-01-21T23:19:38,270   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-01-21T23:19:38,271   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-01-21T23:19:38,274   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-01-21T23:19:38,276   creating build/lib/deepspeed/profiling
2025-01-21T23:19:38,277   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-01-21T23:19:38,279   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-01-21T23:19:38,281   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-01-21T23:19:38,283   creating build/lib/deepspeed/pipe
2025-01-21T23:19:38,284   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-01-21T23:19:38,287   creating build/lib/deepspeed/runtime/comm
2025-01-21T23:19:38,288   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-01-21T23:19:38,290   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-01-21T23:19:38,293   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-01-21T23:19:38,295   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-01-21T23:19:38,297   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-01-21T23:19:38,299   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-01-21T23:19:38,302   creating build/lib/deepspeed/runtime/domino
2025-01-21T23:19:38,303   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-01-21T23:19:38,306   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-01-21T23:19:38,308   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:38,309   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:38,311   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:38,313   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:38,316   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:38,318   creating build/lib/deepspeed/runtime/compression
2025-01-21T23:19:38,319   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-01-21T23:19:38,321   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-01-21T23:19:38,324   creating build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,325   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,328   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,330   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,335   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,337   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,340   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,344   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,347   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,351   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,354   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,356   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,359   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,361   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,363   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,366   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,368   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,370   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-01-21T23:19:38,373   creating build/lib/deepspeed/runtime/fp16
2025-01-21T23:19:38,374   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-01-21T23:19:38,377   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-01-21T23:19:38,379   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-01-21T23:19:38,382   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-01-21T23:19:38,384   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-01-21T23:19:38,385   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-01-21T23:19:38,387   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-01-21T23:19:38,390   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-01-21T23:19:38,393   creating build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,394   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,396   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,399   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,401   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,404   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,407   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,409   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,411   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,413   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-01-21T23:19:38,415   creating build/lib/deepspeed/runtime/data_pipeline
2025-01-21T23:19:38,416   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-01-21T23:19:38,419   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-01-21T23:19:38,421   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-01-21T23:19:38,423   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-01-21T23:19:38,426   creating build/lib/deepspeed/runtime/pipe
2025-01-21T23:19:38,427   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-01-21T23:19:38,431   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-01-21T23:19:38,434   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-01-21T23:19:38,437   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-01-21T23:19:38,439   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-01-21T23:19:38,442   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-01-21T23:19:38,444   creating build/lib/deepspeed/runtime/fp16/onebit
2025-01-21T23:19:38,446   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-01-21T23:19:38,448   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-01-21T23:19:38,451   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-01-21T23:19:38,454   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-01-21T23:19:38,456   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:38,457   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:38,460   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:38,462   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:38,464   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:38,466   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:38,469   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:38,470   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:38,472   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:38,475   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:38,479   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:38,481   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:38,484   creating build/lib/deepspeed/model_implementations/diffusers
2025-01-21T23:19:38,485   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-01-21T23:19:38,488   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-01-21T23:19:38,490   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-01-21T23:19:38,492   creating build/lib/deepspeed/model_implementations/features
2025-01-21T23:19:38,494   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-01-21T23:19:38,496   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-01-21T23:19:38,498   creating build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,500   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,502   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,504   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,506   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,509   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,511   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,512   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,514   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,516   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,518   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-01-21T23:19:38,521   creating build/lib/deepspeed/autotuning/tuner
2025-01-21T23:19:38,522   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-01-21T23:19:38,525   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-01-21T23:19:38,527   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-01-21T23:19:38,529   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-01-21T23:19:38,531   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-01-21T23:19:38,533   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-01-21T23:19:38,535   creating build/lib/deepspeed/ops/aio
2025-01-21T23:19:38,536   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-01-21T23:19:38,539   creating build/lib/deepspeed/ops/lamb
2025-01-21T23:19:38,540   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-01-21T23:19:38,542   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-01-21T23:19:38,545   creating build/lib/deepspeed/ops/deepspeed4science
2025-01-21T23:19:38,546   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-01-21T23:19:38,548   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-01-21T23:19:38,550   creating build/lib/deepspeed/ops/lion
2025-01-21T23:19:38,552   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-01-21T23:19:38,554   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-01-21T23:19:38,556   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-01-21T23:19:38,558   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-01-21T23:19:38,561   creating build/lib/deepspeed/ops/adam
2025-01-21T23:19:38,562   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-01-21T23:19:38,564   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-01-21T23:19:38,566   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-01-21T23:19:38,568   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-01-21T23:19:38,571   creating build/lib/deepspeed/ops/quantizer
2025-01-21T23:19:38,572   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-01-21T23:19:38,574   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-01-21T23:19:38,577   creating build/lib/deepspeed/ops/random_ltd
2025-01-21T23:19:38,578   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-01-21T23:19:38,580   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-01-21T23:19:38,583   creating build/lib/deepspeed/ops/adagrad
2025-01-21T23:19:38,584   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-01-21T23:19:38,586   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-01-21T23:19:38,589   creating build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,591   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,593   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,595   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,598   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,600   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,602   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,604   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,606   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,609   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,611   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,613   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,615   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,617   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,619   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,621   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,623   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,625   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,627   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,629   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,631   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,633   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,635   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,637   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,639   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-01-21T23:19:38,641   creating build/lib/deepspeed/ops/transformer
2025-01-21T23:19:38,642   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-01-21T23:19:38,645   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-01-21T23:19:38,647   creating build/lib/deepspeed/ops/fp_quantizer
2025-01-21T23:19:38,649   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-01-21T23:19:38,651   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-01-21T23:19:38,653   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-01-21T23:19:38,655   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-01-21T23:19:38,658   creating build/lib/deepspeed/ops/sparse_attention
2025-01-21T23:19:38,659   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-01-21T23:19:38,663   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-01-21T23:19:38,666   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-01-21T23:19:38,668   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-01-21T23:19:38,671   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-01-21T23:19:38,673   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-01-21T23:19:38,675   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-01-21T23:19:38,678   creating build/lib/deepspeed/ops/gds
2025-01-21T23:19:38,679   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-01-21T23:19:38,682   creating build/lib/deepspeed/ops/op_builder/hpu
2025-01-21T23:19:38,683   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-01-21T23:19:38,686   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-01-21T23:19:38,688   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-01-21T23:19:38,690   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-01-21T23:19:38,691   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-01-21T23:19:38,693   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-01-21T23:19:38,696   creating build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,697   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,699   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,702   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,703   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,706   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,708   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,710   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,712   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,713   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-01-21T23:19:38,716   creating build/lib/deepspeed/ops/op_builder/mlu
2025-01-21T23:19:38,717   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-01-21T23:19:38,719   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-01-21T23:19:38,721   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-01-21T23:19:38,723   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-01-21T23:19:38,725   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-01-21T23:19:38,727   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-01-21T23:19:38,730   creating build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,731   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,733   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,736   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,738   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,740   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,742   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,744   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,746   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,748   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,750   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:38,753   creating build/lib/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:38,754   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:38,756   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:38,758   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:38,760   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:38,762   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:38,764   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:38,766   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:38,769   creating build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,770   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,772   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,775   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,777   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,780   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,782   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,783   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,786   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,788   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,791   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-01-21T23:19:38,795   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,797   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,800   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,804   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,808   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,812   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,814   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,816   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,818   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,820   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,822   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:38,825   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,827   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,829   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,831   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,833   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,835   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,837   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,839   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,840   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,842   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,844   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,846   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,848   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,850   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,852   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,853   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,856   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,858   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,860   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,862   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,864   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,867   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,868   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,870   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:38,873   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:38,874   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:38,877   creating build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,878   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,880   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,882   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,885   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,887   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,889   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,891   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,893   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,895   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,897   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,900   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,901   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,904   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,906   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,908   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,909   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,912   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,914   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,916   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-01-21T23:19:38,919   creating build/lib/deepspeed/module_inject/containers/features
2025-01-21T23:19:38,920   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-01-21T23:19:38,923   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-01-21T23:19:38,925   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-01-21T23:19:38,927   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-01-21T23:19:38,929   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-01-21T23:19:38,931   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-01-21T23:19:38,934   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-01-21T23:19:38,936   creating build/lib/deepspeed/inference/quantization
2025-01-21T23:19:38,937   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-01-21T23:19:38,940   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-01-21T23:19:38,942   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-01-21T23:19:38,944   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-01-21T23:19:38,946   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-01-21T23:19:38,948   creating build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,950   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,952   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,954   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,956   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,958   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,960   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,962   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,963   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,966   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-01-21T23:19:38,968   creating build/lib/deepspeed/inference/v2/modules
2025-01-21T23:19:38,969   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-01-21T23:19:38,971   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-01-21T23:19:38,973   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-01-21T23:19:38,975   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-01-21T23:19:38,977   creating build/lib/deepspeed/inference/v2/kernels
2025-01-21T23:19:38,978   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-01-21T23:19:38,980   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-01-21T23:19:38,983   creating build/lib/deepspeed/inference/v2/ragged
2025-01-21T23:19:38,984   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-01-21T23:19:38,986   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-01-21T23:19:38,989   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-01-21T23:19:38,991   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-01-21T23:19:38,993   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-01-21T23:19:38,996   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-01-21T23:19:38,998   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-01-21T23:19:39,000   creating build/lib/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:39,002   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:39,004   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:39,007   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:39,009   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:39,012   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:39,015   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:39,017   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:39,019   creating build/lib/deepspeed/inference/v2/checkpoint
2025-01-21T23:19:39,021   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-01-21T23:19:39,023   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-01-21T23:19:39,025   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-01-21T23:19:39,027   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-01-21T23:19:39,030   creating build/lib/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:39,031   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:39,033   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:39,035   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:39,037   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:39,039   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:39,041   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:39,042   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:39,045   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,046   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,048   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,050   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,052   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,054   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,056   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,058   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,060   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:39,063   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-01-21T23:19:39,064   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-01-21T23:19:39,066   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-01-21T23:19:39,068   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-01-21T23:19:39,070   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-01-21T23:19:39,072   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-01-21T23:19:39,075   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-01-21T23:19:39,076   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-01-21T23:19:39,078   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-01-21T23:19:39,080   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-01-21T23:19:39,083   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-01-21T23:19:39,084   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-01-21T23:19:39,087   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-01-21T23:19:39,089   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-01-21T23:19:39,091   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-01-21T23:19:39,093   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-01-21T23:19:39,095   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-01-21T23:19:39,096   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-01-21T23:19:39,099   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-01-21T23:19:39,101   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-01-21T23:19:39,102   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-01-21T23:19:39,104   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-01-21T23:19:39,106   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-01-21T23:19:39,107   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-01-21T23:19:39,110   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-01-21T23:19:39,112   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-01-21T23:19:39,113   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-01-21T23:19:39,115   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-01-21T23:19:39,116   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-01-21T23:19:39,119   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-01-21T23:19:39,120   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-01-21T23:19:39,122   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:39,124   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:39,126   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:39,128   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:39,130   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:39,132   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:39,134   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:39,136   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:39,137   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:39,139   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:39,142   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:39,143   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:39,145   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:39,147   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:39,149   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:39,151   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:39,153   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:39,154   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:39,156   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:39,159   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:39,160   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:39,162   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:39,164   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:39,166   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:39,168   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:39,170   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:39,172   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:39,175   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:39,176   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:39,178   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:39,180   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:39,182   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:39,184   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:39,186   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:39,188   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:39,190   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:39,192   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:39,193   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:39,195   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:39,198   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:39,199   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:39,201   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:39,203   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:39,205   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:39,207   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:39,209   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:39,211   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:39,213   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:39,215   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:39,217   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:39,220   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:39,221   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:39,223   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:39,225   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:39,227   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:39,229   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:39,231   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:39,233   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:39,235   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:39,237   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:39,239   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:39,242   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:39,243   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:39,245   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:39,247   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:39,250   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:39,252   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:39,253   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:39,255   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:39,257   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:39,259   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:39,262   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,263   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,266   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,268   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,270   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,272   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,274   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,276   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,278   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,280   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:39,283   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:39,284   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:39,286   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:39,288   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:39,290   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:39,293   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:39,294   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:39,296   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:39,298   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:39,301   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:39,303   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:39,304   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:39,306   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:39,308   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:39,311   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:39,313   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:39,314   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:39,316   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:39,318   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:39,320   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:39,323   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:39,324   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:39,326   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:39,328   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:39,330   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:39,332   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:39,333   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:39,336   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:39,337   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:39,339   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:39,342   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,343   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,345   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,347   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,349   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,351   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,353   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,355   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,357   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,359   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:39,361   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:39,362   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:39,365   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:39,367   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:39,369   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:39,371   creating build/lib/deepspeed/profiling/flops_profiler
2025-01-21T23:19:39,372   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-01-21T23:19:39,375   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-01-21T23:19:39,378   running egg_info
2025-01-21T23:19:39,407   writing deepspeed.egg-info/PKG-INFO
2025-01-21T23:19:39,441   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-01-21T23:19:39,443   writing entry points to deepspeed.egg-info/entry_points.txt
2025-01-21T23:19:39,460   writing requirements to deepspeed.egg-info/requires.txt
2025-01-21T23:19:39,461   writing top-level names to deepspeed.egg-info/top_level.txt
2025-01-21T23:19:39,593   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-01-21T23:19:39,676   reading manifest template 'MANIFEST.in'
2025-01-21T23:19:39,677   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-01-21T23:19:39,678   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-01-21T23:19:41,382   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-01-21T23:19:42,316   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-01-21T23:19:42,908   warning: no files found matching '*.tr' under directory 'csrc'
2025-01-21T23:19:43,043   warning: no files found matching '*.cc' under directory 'csrc'
2025-01-21T23:19:43,087   warning: no files found matching '*.py' under directory 'benchmarks'
2025-01-21T23:19:43,093   adding license file 'LICENSE'
2025-01-21T23:19:43,144   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-01-21T23:19:43,152   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-01-21T23:19:43,153   !!

2025-01-21T23:19:43,154           ********************************************************************************
2025-01-21T23:19:43,155           ############################
2025-01-21T23:19:43,155           # Package would be ignored #
2025-01-21T23:19:43,156           ############################
2025-01-21T23:19:43,157           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-01-21T23:19:43,157           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,158           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,159           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-01-21T23:19:43,159           to the `packages` configuration field.

2025-01-21T23:19:43,160           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,160           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,161           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,161           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,162           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,163           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-01-21T23:19:43,163           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-01-21T23:19:43,164           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,164           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,165           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,165           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,166           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,167           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,168                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,169                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,169                 directory, all directories are treated like packages.
2025-01-21T23:19:43,170           ********************************************************************************

2025-01-21T23:19:43,171   !!
2025-01-21T23:19:43,171     check.warn(importable)
2025-01-21T23:19:43,172   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-01-21T23:19:43,173   !!

2025-01-21T23:19:43,174           ********************************************************************************
2025-01-21T23:19:43,175           ############################
2025-01-21T23:19:43,175           # Package would be ignored #
2025-01-21T23:19:43,176           ############################
2025-01-21T23:19:43,177           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-01-21T23:19:43,177           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,178           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,179           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-01-21T23:19:43,179           to the `packages` configuration field.

2025-01-21T23:19:43,181           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,181           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,182           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,183           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,184           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,185           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-01-21T23:19:43,186           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-01-21T23:19:43,187           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,187           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,188           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,189           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,189           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,191           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,191                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,191                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,192                 directory, all directories are treated like packages.
2025-01-21T23:19:43,192           ********************************************************************************

2025-01-21T23:19:43,193   !!
2025-01-21T23:19:43,193     check.warn(importable)
2025-01-21T23:19:43,194   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-01-21T23:19:43,194   !!

2025-01-21T23:19:43,195           ********************************************************************************
2025-01-21T23:19:43,195           ############################
2025-01-21T23:19:43,195           # Package would be ignored #
2025-01-21T23:19:43,196           ############################
2025-01-21T23:19:43,197           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-01-21T23:19:43,197           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,198           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,198           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-01-21T23:19:43,198           to the `packages` configuration field.

2025-01-21T23:19:43,200           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,200           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,201           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,202           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,203           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,204           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-01-21T23:19:43,204           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-01-21T23:19:43,205           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,205           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,205           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,206           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,207           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,209           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,209                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,210                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,210                 directory, all directories are treated like packages.
2025-01-21T23:19:43,211           ********************************************************************************

2025-01-21T23:19:43,212   !!
2025-01-21T23:19:43,213     check.warn(importable)
2025-01-21T23:19:43,213   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-01-21T23:19:43,213   !!

2025-01-21T23:19:43,214           ********************************************************************************
2025-01-21T23:19:43,215           ############################
2025-01-21T23:19:43,215           # Package would be ignored #
2025-01-21T23:19:43,215           ############################
2025-01-21T23:19:43,216           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-01-21T23:19:43,216           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,217           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,217           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-01-21T23:19:43,217           to the `packages` configuration field.

2025-01-21T23:19:43,218           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,218           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,219           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,219           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,220           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,221           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-01-21T23:19:43,222           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-01-21T23:19:43,222           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,223           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,223           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,225           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,226           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,227           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,228                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,229                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,229                 directory, all directories are treated like packages.
2025-01-21T23:19:43,230           ********************************************************************************

2025-01-21T23:19:43,231   !!
2025-01-21T23:19:43,231     check.warn(importable)
2025-01-21T23:19:43,232   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-01-21T23:19:43,232   !!

2025-01-21T23:19:43,233           ********************************************************************************
2025-01-21T23:19:43,234           ############################
2025-01-21T23:19:43,234           # Package would be ignored #
2025-01-21T23:19:43,234           ############################
2025-01-21T23:19:43,235           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-01-21T23:19:43,235           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,237           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,237           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-01-21T23:19:43,238           to the `packages` configuration field.

2025-01-21T23:19:43,239           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,239           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,239           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,240           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,241           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,241           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-01-21T23:19:43,242           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-01-21T23:19:43,242           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,244           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,245           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,245           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,246           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,247           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,248                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,248                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,248                 directory, all directories are treated like packages.
2025-01-21T23:19:43,249           ********************************************************************************

2025-01-21T23:19:43,250   !!
2025-01-21T23:19:43,250     check.warn(importable)
2025-01-21T23:19:43,251   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-01-21T23:19:43,251   !!

2025-01-21T23:19:43,252           ********************************************************************************
2025-01-21T23:19:43,253           ############################
2025-01-21T23:19:43,253           # Package would be ignored #
2025-01-21T23:19:43,254           ############################
2025-01-21T23:19:43,254           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-01-21T23:19:43,255           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,256           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,257           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-01-21T23:19:43,257           to the `packages` configuration field.

2025-01-21T23:19:43,258           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,258           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,259           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,260           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,261           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,262           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-01-21T23:19:43,262           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-01-21T23:19:43,263           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,263           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,264           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,265           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,266           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,266           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,267                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,267                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,267                 directory, all directories are treated like packages.
2025-01-21T23:19:43,268           ********************************************************************************

2025-01-21T23:19:43,269   !!
2025-01-21T23:19:43,269     check.warn(importable)
2025-01-21T23:19:43,269   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-01-21T23:19:43,270   !!

2025-01-21T23:19:43,270           ********************************************************************************
2025-01-21T23:19:43,271           ############################
2025-01-21T23:19:43,271           # Package would be ignored #
2025-01-21T23:19:43,271           ############################
2025-01-21T23:19:43,272           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-01-21T23:19:43,272           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,273           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,273           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-01-21T23:19:43,274           to the `packages` configuration field.

2025-01-21T23:19:43,275           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,276           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,276           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,277           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,278           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,279           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-01-21T23:19:43,280           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-01-21T23:19:43,280           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,281           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,281           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,282           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,283           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,285           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,285                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,285                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,286                 directory, all directories are treated like packages.
2025-01-21T23:19:43,286           ********************************************************************************

2025-01-21T23:19:43,287   !!
2025-01-21T23:19:43,288     check.warn(importable)
2025-01-21T23:19:43,289   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-01-21T23:19:43,289   !!

2025-01-21T23:19:43,290           ********************************************************************************
2025-01-21T23:19:43,291           ############################
2025-01-21T23:19:43,291           # Package would be ignored #
2025-01-21T23:19:43,292           ############################
2025-01-21T23:19:43,292           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-01-21T23:19:43,293           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,293           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,294           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-01-21T23:19:43,294           to the `packages` configuration field.

2025-01-21T23:19:43,295           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,295           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,295           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,296           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,297           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,298           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-01-21T23:19:43,298           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-01-21T23:19:43,298           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,299           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,299           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,300           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,301           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,303           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,304                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,304                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,305                 directory, all directories are treated like packages.
2025-01-21T23:19:43,305           ********************************************************************************

2025-01-21T23:19:43,306   !!
2025-01-21T23:19:43,307     check.warn(importable)
2025-01-21T23:19:43,307   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-01-21T23:19:43,308   !!

2025-01-21T23:19:43,309           ********************************************************************************
2025-01-21T23:19:43,309           ############################
2025-01-21T23:19:43,310           # Package would be ignored #
2025-01-21T23:19:43,310           ############################
2025-01-21T23:19:43,311           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-01-21T23:19:43,311           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,312           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,313           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-01-21T23:19:43,313           to the `packages` configuration field.

2025-01-21T23:19:43,314           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,315           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,315           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,316           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,318           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,319           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-01-21T23:19:43,319           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-01-21T23:19:43,320           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,320           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,321           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,321           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,322           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,323           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,324                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,324                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,324                 directory, all directories are treated like packages.
2025-01-21T23:19:43,325           ********************************************************************************

2025-01-21T23:19:43,325   !!
2025-01-21T23:19:43,326     check.warn(importable)
2025-01-21T23:19:43,326   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-01-21T23:19:43,327   !!

2025-01-21T23:19:43,327           ********************************************************************************
2025-01-21T23:19:43,328           ############################
2025-01-21T23:19:43,329           # Package would be ignored #
2025-01-21T23:19:43,329           ############################
2025-01-21T23:19:43,330           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-01-21T23:19:43,330           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,331           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,332           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-01-21T23:19:43,333           to the `packages` configuration field.

2025-01-21T23:19:43,334           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,334           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,335           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,336           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,337           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,338           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-01-21T23:19:43,339           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-01-21T23:19:43,339           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,339           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,340           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,341           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,342           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,344           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,344                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,345                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,345                 directory, all directories are treated like packages.
2025-01-21T23:19:43,346           ********************************************************************************

2025-01-21T23:19:43,347   !!
2025-01-21T23:19:43,347     check.warn(importable)
2025-01-21T23:19:43,348   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-01-21T23:19:43,348   !!

2025-01-21T23:19:43,349           ********************************************************************************
2025-01-21T23:19:43,349           ############################
2025-01-21T23:19:43,350           # Package would be ignored #
2025-01-21T23:19:43,350           ############################
2025-01-21T23:19:43,350           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-01-21T23:19:43,351           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,351           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,352           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-01-21T23:19:43,352           to the `packages` configuration field.

2025-01-21T23:19:43,353           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,353           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,354           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,354           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,355           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,356           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-01-21T23:19:43,357           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-01-21T23:19:43,357           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,358           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,358           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,359           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,361           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,362           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,363                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,363                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,364                 directory, all directories are treated like packages.
2025-01-21T23:19:43,364           ********************************************************************************

2025-01-21T23:19:43,365   !!
2025-01-21T23:19:43,365     check.warn(importable)
2025-01-21T23:19:43,366   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-01-21T23:19:43,366   !!

2025-01-21T23:19:43,367           ********************************************************************************
2025-01-21T23:19:43,368           ############################
2025-01-21T23:19:43,368           # Package would be ignored #
2025-01-21T23:19:43,369           ############################
2025-01-21T23:19:43,369           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-01-21T23:19:43,370           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,371           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,371           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-01-21T23:19:43,372           to the `packages` configuration field.

2025-01-21T23:19:43,373           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,374           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,375           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,375           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,376           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,377           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-01-21T23:19:43,377           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-01-21T23:19:43,378           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,378           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,378           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,379           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,380           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,381           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,381                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,382                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,382                 directory, all directories are treated like packages.
2025-01-21T23:19:43,382           ********************************************************************************

2025-01-21T23:19:43,383   !!
2025-01-21T23:19:43,384     check.warn(importable)
2025-01-21T23:19:43,385   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-01-21T23:19:43,385   !!

2025-01-21T23:19:43,386           ********************************************************************************
2025-01-21T23:19:43,387           ############################
2025-01-21T23:19:43,387           # Package would be ignored #
2025-01-21T23:19:43,388           ############################
2025-01-21T23:19:43,389           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-01-21T23:19:43,389           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,390           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,391           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-01-21T23:19:43,391           to the `packages` configuration field.

2025-01-21T23:19:43,392           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,393           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,393           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,395           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,395           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,397           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-01-21T23:19:43,397           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-01-21T23:19:43,398           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,398           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,399           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,400           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,401           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,403           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,403                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,403                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,404                 directory, all directories are treated like packages.
2025-01-21T23:19:43,404           ********************************************************************************

2025-01-21T23:19:43,405   !!
2025-01-21T23:19:43,405     check.warn(importable)
2025-01-21T23:19:43,406   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-01-21T23:19:43,406   !!

2025-01-21T23:19:43,407           ********************************************************************************
2025-01-21T23:19:43,407           ############################
2025-01-21T23:19:43,407           # Package would be ignored #
2025-01-21T23:19:43,408           ############################
2025-01-21T23:19:43,408           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-01-21T23:19:43,409           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,409           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,410           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-01-21T23:19:43,410           to the `packages` configuration field.

2025-01-21T23:19:43,411           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,411           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,412           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,413           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,414           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,415           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-01-21T23:19:43,416           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-01-21T23:19:43,417           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,417           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,418           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,419           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,420           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,422           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,422                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,423                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,423                 directory, all directories are treated like packages.
2025-01-21T23:19:43,424           ********************************************************************************

2025-01-21T23:19:43,425   !!
2025-01-21T23:19:43,425     check.warn(importable)
2025-01-21T23:19:43,426   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-01-21T23:19:43,426   !!

2025-01-21T23:19:43,427           ********************************************************************************
2025-01-21T23:19:43,428           ############################
2025-01-21T23:19:43,428           # Package would be ignored #
2025-01-21T23:19:43,429           ############################
2025-01-21T23:19:43,429           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-01-21T23:19:43,430           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,431           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,431           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-01-21T23:19:43,432           to the `packages` configuration field.

2025-01-21T23:19:43,433           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,433           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,433           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,434           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,435           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,435           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-01-21T23:19:43,436           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-01-21T23:19:43,436           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,437           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,437           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,438           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,438           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,440           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,441                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,441                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,442                 directory, all directories are treated like packages.
2025-01-21T23:19:43,442           ********************************************************************************

2025-01-21T23:19:43,443   !!
2025-01-21T23:19:43,444     check.warn(importable)
2025-01-21T23:19:43,444   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-01-21T23:19:43,445   !!

2025-01-21T23:19:43,446           ********************************************************************************
2025-01-21T23:19:43,447           ############################
2025-01-21T23:19:43,447           # Package would be ignored #
2025-01-21T23:19:43,448           ############################
2025-01-21T23:19:43,449           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-01-21T23:19:43,449           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,450           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,451           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-01-21T23:19:43,451           to the `packages` configuration field.

2025-01-21T23:19:43,452           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,453           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,453           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,454           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,455           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,457           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-01-21T23:19:43,457           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-01-21T23:19:43,458           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,458           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,459           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,460           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,461           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,462           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,462                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,462                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,463                 directory, all directories are treated like packages.
2025-01-21T23:19:43,463           ********************************************************************************

2025-01-21T23:19:43,464   !!
2025-01-21T23:19:43,465     check.warn(importable)
2025-01-21T23:19:43,465   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-01-21T23:19:43,466   !!

2025-01-21T23:19:43,467           ********************************************************************************
2025-01-21T23:19:43,467           ############################
2025-01-21T23:19:43,468           # Package would be ignored #
2025-01-21T23:19:43,469           ############################
2025-01-21T23:19:43,469           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-01-21T23:19:43,470           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,471           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,471           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-01-21T23:19:43,472           to the `packages` configuration field.

2025-01-21T23:19:43,473           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,474           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,475           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,476           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,477           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,478           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-01-21T23:19:43,479           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-01-21T23:19:43,479           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,480           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,481           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,516           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,518           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,520           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,521                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,521                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,522                 directory, all directories are treated like packages.
2025-01-21T23:19:43,522           ********************************************************************************

2025-01-21T23:19:43,524   !!
2025-01-21T23:19:43,524     check.warn(importable)
2025-01-21T23:19:43,525   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-01-21T23:19:43,525   !!

2025-01-21T23:19:43,527           ********************************************************************************
2025-01-21T23:19:43,527           ############################
2025-01-21T23:19:43,528           # Package would be ignored #
2025-01-21T23:19:43,529           ############################
2025-01-21T23:19:43,529           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-01-21T23:19:43,529           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,530           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,531           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-01-21T23:19:43,531           to the `packages` configuration field.

2025-01-21T23:19:43,533           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,533           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,534           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,535           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,536           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,537           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-01-21T23:19:43,538           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-01-21T23:19:43,539           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,539           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,540           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,542           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,543           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,546           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,547                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,548                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,549                 directory, all directories are treated like packages.
2025-01-21T23:19:43,550           ********************************************************************************

2025-01-21T23:19:43,552   !!
2025-01-21T23:19:43,553     check.warn(importable)
2025-01-21T23:19:43,554   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-01-21T23:19:43,594   !!

2025-01-21T23:19:43,595           ********************************************************************************
2025-01-21T23:19:43,596           ############################
2025-01-21T23:19:43,597           # Package would be ignored #
2025-01-21T23:19:43,597           ############################
2025-01-21T23:19:43,597           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-01-21T23:19:43,598           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,599           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,599           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-01-21T23:19:43,600           to the `packages` configuration field.

2025-01-21T23:19:43,601           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,602           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,602           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,603           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,604           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,605           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-01-21T23:19:43,605           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-01-21T23:19:43,605           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,606           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,606           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,607           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,607           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,608           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,609                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,609                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,610                 directory, all directories are treated like packages.
2025-01-21T23:19:43,610           ********************************************************************************

2025-01-21T23:19:43,611   !!
2025-01-21T23:19:43,612     check.warn(importable)
2025-01-21T23:19:43,612   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-01-21T23:19:43,612   !!

2025-01-21T23:19:43,613           ********************************************************************************
2025-01-21T23:19:43,614           ############################
2025-01-21T23:19:43,615           # Package would be ignored #
2025-01-21T23:19:43,615           ############################
2025-01-21T23:19:43,616           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-01-21T23:19:43,616           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,617           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,618           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-01-21T23:19:43,619           to the `packages` configuration field.

2025-01-21T23:19:43,619           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,620           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,620           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,621           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,622           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,623           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-01-21T23:19:43,624           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-01-21T23:19:43,625           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,625           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,626           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,627           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,628           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,629           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,629                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,630                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,630                 directory, all directories are treated like packages.
2025-01-21T23:19:43,630           ********************************************************************************

2025-01-21T23:19:43,633   !!
2025-01-21T23:19:43,633     check.warn(importable)
2025-01-21T23:19:43,633   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-01-21T23:19:43,634   !!

2025-01-21T23:19:43,635           ********************************************************************************
2025-01-21T23:19:43,635           ############################
2025-01-21T23:19:43,635           # Package would be ignored #
2025-01-21T23:19:43,636           ############################
2025-01-21T23:19:43,636           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-01-21T23:19:43,636           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,637           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,638           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-01-21T23:19:43,638           to the `packages` configuration field.

2025-01-21T23:19:43,639           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,640           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,640           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,641           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,642           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,643           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-01-21T23:19:43,643           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-01-21T23:19:43,644           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,644           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,645           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,646           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,647           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,648           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,649                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,649                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,649                 directory, all directories are treated like packages.
2025-01-21T23:19:43,650           ********************************************************************************

2025-01-21T23:19:43,651   !!
2025-01-21T23:19:43,651     check.warn(importable)
2025-01-21T23:19:43,652   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-01-21T23:19:43,653   !!

2025-01-21T23:19:43,654           ********************************************************************************
2025-01-21T23:19:43,654           ############################
2025-01-21T23:19:43,655           # Package would be ignored #
2025-01-21T23:19:43,655           ############################
2025-01-21T23:19:43,656           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-01-21T23:19:43,656           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,657           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,657           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-01-21T23:19:43,658           to the `packages` configuration field.

2025-01-21T23:19:43,658           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,659           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,659           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,660           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,660           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,661           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-01-21T23:19:43,661           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-01-21T23:19:43,662           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,662           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,662           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,663           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,664           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,665           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,666                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,666                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,667                 directory, all directories are treated like packages.
2025-01-21T23:19:43,667           ********************************************************************************

2025-01-21T23:19:43,668   !!
2025-01-21T23:19:43,669     check.warn(importable)
2025-01-21T23:19:43,669   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-01-21T23:19:43,670   !!

2025-01-21T23:19:43,670           ********************************************************************************
2025-01-21T23:19:43,671           ############################
2025-01-21T23:19:43,671           # Package would be ignored #
2025-01-21T23:19:43,672           ############################
2025-01-21T23:19:43,672           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-01-21T23:19:43,673           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,674           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,674           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-01-21T23:19:43,675           to the `packages` configuration field.

2025-01-21T23:19:43,676           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,676           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,677           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,678           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,679           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,680           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-01-21T23:19:43,680           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-01-21T23:19:43,681           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,681           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,681           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,682           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,683           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,684           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,684                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,685                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,685                 directory, all directories are treated like packages.
2025-01-21T23:19:43,685           ********************************************************************************

2025-01-21T23:19:43,686   !!
2025-01-21T23:19:43,686     check.warn(importable)
2025-01-21T23:19:43,687   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-01-21T23:19:43,687   !!

2025-01-21T23:19:43,688           ********************************************************************************
2025-01-21T23:19:43,689           ############################
2025-01-21T23:19:43,689           # Package would be ignored #
2025-01-21T23:19:43,690           ############################
2025-01-21T23:19:43,690           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-01-21T23:19:43,691           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,693           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,693           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-01-21T23:19:43,694           to the `packages` configuration field.

2025-01-21T23:19:43,695           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,696           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,697           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,698           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,699           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,700           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-01-21T23:19:43,701           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-01-21T23:19:43,702           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,702           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,703           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,708           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,710           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,712           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,712                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,713                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,714                 directory, all directories are treated like packages.
2025-01-21T23:19:43,715           ********************************************************************************

2025-01-21T23:19:43,716   !!
2025-01-21T23:19:43,717     check.warn(importable)
2025-01-21T23:19:43,718   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-01-21T23:19:43,718   !!

2025-01-21T23:19:43,719           ********************************************************************************
2025-01-21T23:19:43,720           ############################
2025-01-21T23:19:43,721           # Package would be ignored #
2025-01-21T23:19:43,721           ############################
2025-01-21T23:19:43,722           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-01-21T23:19:43,723           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,724           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,724           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-01-21T23:19:43,725           to the `packages` configuration field.

2025-01-21T23:19:43,726           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,727           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,727           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,728           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,729           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,731           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-01-21T23:19:43,731           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-01-21T23:19:43,732           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,733           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,733           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,735           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,736           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,738           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,739                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,740                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,741                 directory, all directories are treated like packages.
2025-01-21T23:19:43,741           ********************************************************************************

2025-01-21T23:19:43,743   !!
2025-01-21T23:19:43,743     check.warn(importable)
2025-01-21T23:19:43,744   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-01-21T23:19:43,745   !!

2025-01-21T23:19:43,746           ********************************************************************************
2025-01-21T23:19:43,747           ############################
2025-01-21T23:19:43,748           # Package would be ignored #
2025-01-21T23:19:43,748           ############################
2025-01-21T23:19:43,749           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-01-21T23:19:43,750           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,751           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,752           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-01-21T23:19:43,753           to the `packages` configuration field.

2025-01-21T23:19:43,755           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,755           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,756           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,757           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,758           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,759           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-01-21T23:19:43,760           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-01-21T23:19:43,760           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,761           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,762           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,763           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,764           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,766           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,767                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,767                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,768                 directory, all directories are treated like packages.
2025-01-21T23:19:43,769           ********************************************************************************

2025-01-21T23:19:43,770   !!
2025-01-21T23:19:43,771     check.warn(importable)
2025-01-21T23:19:43,771   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-01-21T23:19:43,772   !!

2025-01-21T23:19:43,779           ********************************************************************************
2025-01-21T23:19:43,780           ############################
2025-01-21T23:19:43,780           # Package would be ignored #
2025-01-21T23:19:43,781           ############################
2025-01-21T23:19:43,782           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-01-21T23:19:43,782           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,784           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,785           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-01-21T23:19:43,786           to the `packages` configuration field.

2025-01-21T23:19:43,787           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,788           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,788           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,790           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,791           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,792           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-01-21T23:19:43,793           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-01-21T23:19:43,793           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,794           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,794           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,795           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,796           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,798           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,798                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,799                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,799                 directory, all directories are treated like packages.
2025-01-21T23:19:43,800           ********************************************************************************

2025-01-21T23:19:43,801   !!
2025-01-21T23:19:43,801     check.warn(importable)
2025-01-21T23:19:43,801   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-01-21T23:19:43,802   !!

2025-01-21T23:19:43,803           ********************************************************************************
2025-01-21T23:19:43,803           ############################
2025-01-21T23:19:43,803           # Package would be ignored #
2025-01-21T23:19:43,804           ############################
2025-01-21T23:19:43,805           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-01-21T23:19:43,805           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,806           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,806           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-01-21T23:19:43,807           to the `packages` configuration field.

2025-01-21T23:19:43,808           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,809           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,809           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,810           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,811           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,813           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-01-21T23:19:43,813           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-01-21T23:19:43,814           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,814           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,815           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,816           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,817           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,819           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,819                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,820                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,820                 directory, all directories are treated like packages.
2025-01-21T23:19:43,821           ********************************************************************************

2025-01-21T23:19:43,822   !!
2025-01-21T23:19:43,822     check.warn(importable)
2025-01-21T23:19:43,823   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-01-21T23:19:43,823   !!

2025-01-21T23:19:43,825           ********************************************************************************
2025-01-21T23:19:43,825           ############################
2025-01-21T23:19:43,826           # Package would be ignored #
2025-01-21T23:19:43,826           ############################
2025-01-21T23:19:43,827           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-01-21T23:19:43,827           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,828           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,829           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-01-21T23:19:43,829           to the `packages` configuration field.

2025-01-21T23:19:43,830           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,830           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,831           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,831           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,832           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,833           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-01-21T23:19:43,833           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-01-21T23:19:43,834           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,834           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,835           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,836           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,837           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,838           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,839                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,839                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,840                 directory, all directories are treated like packages.
2025-01-21T23:19:43,840           ********************************************************************************

2025-01-21T23:19:43,841   !!
2025-01-21T23:19:43,842     check.warn(importable)
2025-01-21T23:19:43,842   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-01-21T23:19:43,843   !!

2025-01-21T23:19:43,844           ********************************************************************************
2025-01-21T23:19:43,844           ############################
2025-01-21T23:19:43,845           # Package would be ignored #
2025-01-21T23:19:43,845           ############################
2025-01-21T23:19:43,846           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-01-21T23:19:43,846           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,847           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,848           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-01-21T23:19:43,848           to the `packages` configuration field.

2025-01-21T23:19:43,849           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,850           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,850           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,851           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,853           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,854           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-01-21T23:19:43,854           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-01-21T23:19:43,855           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,855           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,856           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,857           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,858           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,859           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,859                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,860                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,860                 directory, all directories are treated like packages.
2025-01-21T23:19:43,861           ********************************************************************************

2025-01-21T23:19:43,861   !!
2025-01-21T23:19:43,862     check.warn(importable)
2025-01-21T23:19:43,862   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-01-21T23:19:43,863   !!

2025-01-21T23:19:43,864           ********************************************************************************
2025-01-21T23:19:43,864           ############################
2025-01-21T23:19:43,865           # Package would be ignored #
2025-01-21T23:19:43,865           ############################
2025-01-21T23:19:43,866           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-01-21T23:19:43,866           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,867           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,868           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-01-21T23:19:43,869           to the `packages` configuration field.

2025-01-21T23:19:43,870           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,870           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,871           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,872           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,873           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,874           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-01-21T23:19:43,875           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-01-21T23:19:43,876           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,876           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,877           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,879           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,880           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,883           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,883                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,884                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,885                 directory, all directories are treated like packages.
2025-01-21T23:19:43,885           ********************************************************************************

2025-01-21T23:19:43,886   !!
2025-01-21T23:19:43,887     check.warn(importable)
2025-01-21T23:19:43,887   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-01-21T23:19:43,888   !!

2025-01-21T23:19:43,889           ********************************************************************************
2025-01-21T23:19:43,889           ############################
2025-01-21T23:19:43,890           # Package would be ignored #
2025-01-21T23:19:43,890           ############################
2025-01-21T23:19:43,891           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-01-21T23:19:43,891           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,892           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,892           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-01-21T23:19:43,893           to the `packages` configuration field.

2025-01-21T23:19:43,894           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,894           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,895           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,895           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,897           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,898           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-01-21T23:19:43,898           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-01-21T23:19:43,899           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,899           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,900           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,901           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,902           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,904           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,904                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,905                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,905                 directory, all directories are treated like packages.
2025-01-21T23:19:43,906           ********************************************************************************

2025-01-21T23:19:43,907   !!
2025-01-21T23:19:43,907     check.warn(importable)
2025-01-21T23:19:43,908   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-01-21T23:19:43,908   !!

2025-01-21T23:19:43,909           ********************************************************************************
2025-01-21T23:19:43,910           ############################
2025-01-21T23:19:43,910           # Package would be ignored #
2025-01-21T23:19:43,911           ############################
2025-01-21T23:19:43,911           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-01-21T23:19:43,912           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,913           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,914           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-01-21T23:19:43,915           to the `packages` configuration field.

2025-01-21T23:19:43,916           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,916           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,917           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,918           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,919           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,920           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-01-21T23:19:43,920           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-01-21T23:19:43,921           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,921           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,922           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,923           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,924           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,925           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,926                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,926                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,926                 directory, all directories are treated like packages.
2025-01-21T23:19:43,927           ********************************************************************************

2025-01-21T23:19:43,928   !!
2025-01-21T23:19:43,928     check.warn(importable)
2025-01-21T23:19:43,929   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-01-21T23:19:43,929   !!

2025-01-21T23:19:43,930           ********************************************************************************
2025-01-21T23:19:43,931           ############################
2025-01-21T23:19:43,931           # Package would be ignored #
2025-01-21T23:19:43,932           ############################
2025-01-21T23:19:43,932           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-01-21T23:19:43,933           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,934           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,934           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-01-21T23:19:43,935           to the `packages` configuration field.

2025-01-21T23:19:43,936           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,937           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,937           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,938           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,939           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,940           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-01-21T23:19:43,941           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-01-21T23:19:43,942           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,942           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,943           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,944           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,945           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,947           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,947                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,948                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,949                 directory, all directories are treated like packages.
2025-01-21T23:19:43,949           ********************************************************************************

2025-01-21T23:19:43,950   !!
2025-01-21T23:19:43,950     check.warn(importable)
2025-01-21T23:19:43,951   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-01-21T23:19:43,951   !!

2025-01-21T23:19:43,952           ********************************************************************************
2025-01-21T23:19:43,953           ############################
2025-01-21T23:19:43,953           # Package would be ignored #
2025-01-21T23:19:43,954           ############################
2025-01-21T23:19:43,954           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-01-21T23:19:43,955           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,956           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,956           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-01-21T23:19:43,957           to the `packages` configuration field.

2025-01-21T23:19:43,958           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,958           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,959           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,960           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,961           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,962           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-01-21T23:19:43,962           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-01-21T23:19:43,963           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,963           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,964           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,965           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,966           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,968           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,969                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,970                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,970                 directory, all directories are treated like packages.
2025-01-21T23:19:43,971           ********************************************************************************

2025-01-21T23:19:43,972   !!
2025-01-21T23:19:43,972     check.warn(importable)
2025-01-21T23:19:43,973   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-01-21T23:19:43,974   !!

2025-01-21T23:19:43,975           ********************************************************************************
2025-01-21T23:19:43,975           ############################
2025-01-21T23:19:43,976           # Package would be ignored #
2025-01-21T23:19:43,977           ############################
2025-01-21T23:19:43,977           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-01-21T23:19:43,978           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,979           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,979           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-01-21T23:19:43,980           to the `packages` configuration field.

2025-01-21T23:19:43,981           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:43,981           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:43,982           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:43,983           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:43,984           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:43,985           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-01-21T23:19:43,985           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-01-21T23:19:43,986           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:43,986           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:43,986           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:43,987           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:43,988           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:43,990           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:43,990                 even if it does not contain any `.py` files.
2025-01-21T23:19:43,991                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:43,991                 directory, all directories are treated like packages.
2025-01-21T23:19:43,992           ********************************************************************************

2025-01-21T23:19:43,993   !!
2025-01-21T23:19:43,993     check.warn(importable)
2025-01-21T23:19:43,994   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-01-21T23:19:43,994   !!

2025-01-21T23:19:43,995           ********************************************************************************
2025-01-21T23:19:43,996           ############################
2025-01-21T23:19:43,996           # Package would be ignored #
2025-01-21T23:19:43,997           ############################
2025-01-21T23:19:43,997           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-01-21T23:19:43,997           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:43,998           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:43,999           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-01-21T23:19:44,000           to the `packages` configuration field.

2025-01-21T23:19:44,001           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:44,001           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:44,002           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:44,003           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:44,004           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:44,005           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-01-21T23:19:44,005           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-01-21T23:19:44,006           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:44,007           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:44,007           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:44,008           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:44,009           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:44,011           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:44,011                 even if it does not contain any `.py` files.
2025-01-21T23:19:44,012                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:44,012                 directory, all directories are treated like packages.
2025-01-21T23:19:44,014           ********************************************************************************

2025-01-21T23:19:44,015   !!
2025-01-21T23:19:44,015     check.warn(importable)
2025-01-21T23:19:44,016   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-01-21T23:19:44,016   !!

2025-01-21T23:19:44,017           ********************************************************************************
2025-01-21T23:19:44,018           ############################
2025-01-21T23:19:44,018           # Package would be ignored #
2025-01-21T23:19:44,019           ############################
2025-01-21T23:19:44,019           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-01-21T23:19:44,020           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:44,021           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:44,021           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-01-21T23:19:44,022           to the `packages` configuration field.

2025-01-21T23:19:44,023           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:44,023           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:44,024           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:44,025           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:44,026           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:44,028           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-01-21T23:19:44,028           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-01-21T23:19:44,029           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:44,029           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:44,030           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:44,031           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:44,032           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:44,033           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:44,034                 even if it does not contain any `.py` files.
2025-01-21T23:19:44,035                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:44,035                 directory, all directories are treated like packages.
2025-01-21T23:19:44,036           ********************************************************************************

2025-01-21T23:19:44,037   !!
2025-01-21T23:19:44,038     check.warn(importable)
2025-01-21T23:19:44,038   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-01-21T23:19:44,039   !!

2025-01-21T23:19:44,040           ********************************************************************************
2025-01-21T23:19:44,040           ############################
2025-01-21T23:19:44,041           # Package would be ignored #
2025-01-21T23:19:44,041           ############################
2025-01-21T23:19:44,041           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-01-21T23:19:44,042           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:44,043           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:44,043           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-01-21T23:19:44,044           to the `packages` configuration field.

2025-01-21T23:19:44,045           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:44,045           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:44,046           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:44,046           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:44,047           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:44,049           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-01-21T23:19:44,049           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-01-21T23:19:44,050           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:44,050           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:44,051           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:44,051           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:44,053           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:44,054           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:44,055                 even if it does not contain any `.py` files.
2025-01-21T23:19:44,055                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:44,056                 directory, all directories are treated like packages.
2025-01-21T23:19:44,056           ********************************************************************************

2025-01-21T23:19:44,057   !!
2025-01-21T23:19:44,058     check.warn(importable)
2025-01-21T23:19:44,058   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-01-21T23:19:44,059   !!

2025-01-21T23:19:44,060           ********************************************************************************
2025-01-21T23:19:44,061           ############################
2025-01-21T23:19:44,061           # Package would be ignored #
2025-01-21T23:19:44,062           ############################
2025-01-21T23:19:44,062           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-01-21T23:19:44,063           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:44,064           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:44,065           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-01-21T23:19:44,065           to the `packages` configuration field.

2025-01-21T23:19:44,066           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:44,067           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:44,067           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:44,069           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:44,070           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:44,071           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-01-21T23:19:44,071           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-01-21T23:19:44,071           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:44,072           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:44,072           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:44,073           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:44,074           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:44,075           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:44,076                 even if it does not contain any `.py` files.
2025-01-21T23:19:44,076                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:44,077                 directory, all directories are treated like packages.
2025-01-21T23:19:44,077           ********************************************************************************

2025-01-21T23:19:44,078   !!
2025-01-21T23:19:44,079     check.warn(importable)
2025-01-21T23:19:44,079   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-01-21T23:19:44,080   !!

2025-01-21T23:19:44,081           ********************************************************************************
2025-01-21T23:19:44,081           ############################
2025-01-21T23:19:44,082           # Package would be ignored #
2025-01-21T23:19:44,082           ############################
2025-01-21T23:19:44,083           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-01-21T23:19:44,083           but it is absent from setuptools' `packages` configuration.

2025-01-21T23:19:44,084           This leads to an ambiguous overall configuration. If you want to distribute this
2025-01-21T23:19:44,085           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-01-21T23:19:44,085           to the `packages` configuration field.

2025-01-21T23:19:44,086           Alternatively, you can also rely on setuptools' discovery methods
2025-01-21T23:19:44,087           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-01-21T23:19:44,087           instead of `find_packages(...)`/`find:`).

2025-01-21T23:19:44,088           You can read more about "package discovery" on setuptools documentation page:

2025-01-21T23:19:44,089           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-01-21T23:19:44,090           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-01-21T23:19:44,091           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-01-21T23:19:44,091           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-01-21T23:19:44,092           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-01-21T23:19:44,092           combination with a more fine grained `package-data` configuration.

2025-01-21T23:19:44,093           You can read more about "package data files" on setuptools documentation page:

2025-01-21T23:19:44,094           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-01-21T23:19:44,096           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-01-21T23:19:44,096                 even if it does not contain any `.py` files.
2025-01-21T23:19:44,097                 On the other hand, currently there is no concept of package data
2025-01-21T23:19:44,097                 directory, all directories are treated like packages.
2025-01-21T23:19:44,098           ********************************************************************************

2025-01-21T23:19:44,099   !!
2025-01-21T23:19:44,099     check.warn(importable)
2025-01-21T23:19:44,100   creating build/lib/deepspeed/autotuning/config_templates
2025-01-21T23:19:44,100   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-01-21T23:19:44,101   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-01-21T23:19:44,101   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-01-21T23:19:44,102   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-01-21T23:19:44,102   creating build/lib/deepspeed/ops/csrc/adagrad
2025-01-21T23:19:44,102   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-01-21T23:19:44,103   creating build/lib/deepspeed/ops/csrc/adam
2025-01-21T23:19:44,103   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-01-21T23:19:44,104   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-01-21T23:19:44,104   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-01-21T23:19:44,105   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-01-21T23:19:44,105   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-01-21T23:19:44,105   creating build/lib/deepspeed/ops/csrc/aio/common
2025-01-21T23:19:44,106   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-01-21T23:19:44,106   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-01-21T23:19:44,107   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-01-21T23:19:44,107   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-01-21T23:19:44,108   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-01-21T23:19:44,109   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-01-21T23:19:44,109   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,110   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,110   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,111   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,111   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,112   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,113   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,113   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,114   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,114   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,115   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,115   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,116   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,117   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,117   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,118   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,118   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,119   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:44,119   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-01-21T23:19:44,119   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-01-21T23:19:44,120   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-01-21T23:19:44,120   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-01-21T23:19:44,121   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:44,121   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:44,122   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:44,122   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:44,123   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:44,123   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-01-21T23:19:44,124   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-01-21T23:19:44,124   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:44,125   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:44,125   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:44,126   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:44,127   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:44,127   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:44,128   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:44,128   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:44,129   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:44,129   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:44,130   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:44,131   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:44,131   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:44,132   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:44,132   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:44,133   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:44,134   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:44,134   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:44,134   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:44,135   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:44,135   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:44,136   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:44,137   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:44,137   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:44,138   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:44,138   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:44,139   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:44,139   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:44,140   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-01-21T23:19:44,141   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-01-21T23:19:44,141   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-01-21T23:19:44,142   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-01-21T23:19:44,142   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-01-21T23:19:44,143   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-01-21T23:19:44,144   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-01-21T23:19:44,144   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-01-21T23:19:44,145   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-01-21T23:19:44,145   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:44,146   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:44,147   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:44,147   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:44,148   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:44,149   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:44,149   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:44,150   creating build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,150   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,151   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,151   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,152   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,152   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,153   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,154   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,154   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,155   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,155   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,156   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,156   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,157   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,157   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,158   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,159   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,160   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,160   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,161   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,161   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,162   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,162   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,163   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,166   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,168   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,171   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,174   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,176   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,179   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-01-21T23:19:44,182   creating build/lib/deepspeed/ops/csrc/lamb
2025-01-21T23:19:44,183   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-01-21T23:19:44,185   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-01-21T23:19:44,188   creating build/lib/deepspeed/ops/csrc/lion
2025-01-21T23:19:44,189   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-01-21T23:19:44,191   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-01-21T23:19:44,193   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-01-21T23:19:44,195   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-01-21T23:19:44,198   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-01-21T23:19:44,200   creating build/lib/deepspeed/ops/csrc/quantization
2025-01-21T23:19:44,201   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-01-21T23:19:44,204   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-01-21T23:19:44,207   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-01-21T23:19:44,210   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-01-21T23:19:44,213   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-01-21T23:19:44,216   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-01-21T23:19:44,219   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-01-21T23:19:44,222   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:44,223   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:44,226   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:44,228   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:44,231   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:44,233   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-01-21T23:19:44,235   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-01-21T23:19:44,237   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-01-21T23:19:44,239   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-01-21T23:19:44,242   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-01-21T23:19:44,244   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-01-21T23:19:44,245   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-01-21T23:19:44,248   creating build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,249   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,252   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,255   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,258   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,262   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,264   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,268   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,271   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-01-21T23:19:44,274   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,276   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,279   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,281   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,284   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,287   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,289   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,293   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,295   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,298   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,301   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:44,305   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-01-21T23:19:44,306   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-01-21T23:19:44,309   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-01-21T23:19:44,312   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-01-21T23:19:44,314   creating build/lib/deepspeed/ops/csrc/utils
2025-01-21T23:19:44,316   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-01-21T23:19:44,318   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-01-21T23:19:44,320   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-01-21T23:19:44,323   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-01-21T23:19:44,324   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-01-21T23:19:44,326   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-01-21T23:19:44,329   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-01-21T23:19:44,331   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-01-21T23:19:44,332   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-01-21T23:19:44,335   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:44,336   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:44,338   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:44,341   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:44,343   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:44,346   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:44,349   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-01-21T23:19:44,350   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-01-21T23:19:44,353   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:44,356   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:44,358   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:44,361   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:44,363   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:44,365   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:44,368   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:44,371   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:44,374   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:44,377   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-01-21T23:19:44,379   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-01-21T23:19:44,382   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-01-21T23:19:44,384   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-01-21T23:19:44,386   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-01-21T23:19:44,388   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-01-21T23:19:44,390   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-01-21T23:19:44,392   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-01-21T23:19:44,395   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-01-21T23:19:44,397   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-01-21T23:19:44,399   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-01-21T23:19:44,401   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-01-21T23:19:44,403   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-01-21T23:19:44,406   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-01-21T23:19:44,408   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-01-21T23:19:44,411   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-01-21T23:19:44,414   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:44,417   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:44,419   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:44,422   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:44,425   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:44,427   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:44,430   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:44,432   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:44,435   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:44,437   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:44,440   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:44,442   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:44,446   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:44,448   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:44,451   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:44,453   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:44,456   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:44,458   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:44,461   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:44,463   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:44,466   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:44,469   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:44,471   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:44,474   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:44,478   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:44,480   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:44,483   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:44,486   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:44,489   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:44,491   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:44,494   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:44,498   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:44,502   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:44,505   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:44,508   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:44,512   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:44,516   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:44,519   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:44,522   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:44,527   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:44,531   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:44,535   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:44,539   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:44,542   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:44,547   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:44,550   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:44,554   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:44,558   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:44,563   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:44,566   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:44,571   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:44,574   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,576   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,580   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,584   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,588   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,591   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,595   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,598   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,601   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,603   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:44,607   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:44,610   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:44,612   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:44,666   running build_scripts
2025-01-21T23:19:44,667   creating build/scripts-3.11
2025-01-21T23:19:44,669   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-01-21T23:19:44,671   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-01-21T23:19:44,673   copying and adjusting bin/ds -> build/scripts-3.11
2025-01-21T23:19:44,675   copying bin/ds_ssh -> build/scripts-3.11
2025-01-21T23:19:44,677   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-01-21T23:19:44,679   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-01-21T23:19:44,681   copying and adjusting bin/dsr -> build/scripts-3.11
2025-01-21T23:19:44,683   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-01-21T23:19:44,685   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-01-21T23:19:44,687   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-01-21T23:19:44,688   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-01-21T23:19:44,689   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-01-21T23:19:44,690   changing mode of build/scripts-3.11/ds from 644 to 755
2025-01-21T23:19:44,691   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-01-21T23:19:44,691   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-01-21T23:19:44,692   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-01-21T23:19:44,693   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-01-21T23:19:44,694   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-01-21T23:19:44,695   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-01-21T23:19:44,722   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-01-21T23:19:44,723   !!

2025-01-21T23:19:44,723           ********************************************************************************
2025-01-21T23:19:44,724           Please avoid running ``setup.py`` directly.
2025-01-21T23:19:44,724           Instead, use pypa/build, pypa/installer or other
2025-01-21T23:19:44,725           standards-based tools.

2025-01-21T23:19:44,725           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-01-21T23:19:44,726           ********************************************************************************

2025-01-21T23:19:44,727   !!
2025-01-21T23:19:44,727     self.initialize_options()
2025-01-21T23:19:44,752   installing to build/bdist.linux-armv7l/wheel
2025-01-21T23:19:44,753   running install
2025-01-21T23:19:44,777   running install_lib
2025-01-21T23:19:44,804   creating build/bdist.linux-armv7l/wheel
2025-01-21T23:19:44,807   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-01-21T23:19:44,810   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-01-21T23:19:44,811   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-01-21T23:19:44,814   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-01-21T23:19:44,816   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-01-21T23:19:44,818   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-01-21T23:19:44,820   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-01-21T23:19:44,822   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-01-21T23:19:44,825   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-01-21T23:19:44,828   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-01-21T23:19:44,831   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-01-21T23:19:44,833   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-01-21T23:19:44,835   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-01-21T23:19:44,837   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,839   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,841   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,844   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,846   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,850   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,852   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,854   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,856   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-01-21T23:19:44,858   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-01-21T23:19:44,861   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-01-21T23:19:44,863   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-01-21T23:19:44,866   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-01-21T23:19:44,869   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-01-21T23:19:44,871   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-01-21T23:19:44,874   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-01-21T23:19:44,875   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-01-21T23:19:44,878   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-01-21T23:19:44,880   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-01-21T23:19:44,882   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-01-21T23:19:44,884   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-01-21T23:19:44,886   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-01-21T23:19:44,888   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-01-21T23:19:44,890   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-01-21T23:19:44,893   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-01-21T23:19:44,895   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-01-21T23:19:44,897   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-01-21T23:19:44,900   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-01-21T23:19:44,903   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-01-21T23:19:44,906   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-01-21T23:19:44,908   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-01-21T23:19:44,910   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-01-21T23:19:44,913   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-01-21T23:19:44,915   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-01-21T23:19:44,918   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-01-21T23:19:44,920   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,923   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,930   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,933   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,937   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-01-21T23:19:44,938   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-01-21T23:19:44,941   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-01-21T23:19:44,943   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-01-21T23:19:44,946   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-01-21T23:19:44,949   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-01-21T23:19:44,952   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-01-21T23:19:44,954   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,956   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,960   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-01-21T23:19:44,962   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-01-21T23:19:44,965   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-01-21T23:19:44,968   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:44,969   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:44,971   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:44,973   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:44,976   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-01-21T23:19:44,978   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,981   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-01-21T23:19:44,982   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-01-21T23:19:44,984   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-01-21T23:19:44,986   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,989   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:44,992   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-01-21T23:19:44,994   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:44,996   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:44,999   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,005   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,008   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,011   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,015   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,019   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,024   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,026   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,029   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,032   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,034   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,036   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,038   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,039   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,041   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-01-21T23:19:45,043   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,046   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,048   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,050   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-01-21T23:19:45,052   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-01-21T23:19:45,053   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-01-21T23:19:45,056   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-01-21T23:19:45,058   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-01-21T23:19:45,060   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-01-21T23:19:45,062   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-01-21T23:19:45,064   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-01-21T23:19:45,067   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-01-21T23:19:45,069   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-01-21T23:19:45,071   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,073   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,076   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-01-21T23:19:45,077   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-01-21T23:19:45,079   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-01-21T23:19:45,082   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-01-21T23:19:45,084   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,085   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,088   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,090   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,093   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,095   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,098   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,100   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,102   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,103   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-01-21T23:19:45,105   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,107   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,109   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,111   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-01-21T23:19:45,113   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-01-21T23:19:45,115   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-01-21T23:19:45,118   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:45,119   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:45,121   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:45,123   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:45,125   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:45,127   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-01-21T23:19:45,130   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:45,131   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:45,133   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:45,136   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:45,139   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:45,142   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-01-21T23:19:45,143   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-01-21T23:19:45,146   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-01-21T23:19:45,148   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-01-21T23:19:45,151   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-01-21T23:19:45,152   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-01-21T23:19:45,155   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-01-21T23:19:45,158   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-01-21T23:19:45,160   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-01-21T23:19:45,162   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-01-21T23:19:45,165   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-01-21T23:19:45,167   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-01-21T23:19:45,168   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,171   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,172   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,175   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,177   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,179   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,181   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,183   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,185   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,187   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,189   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,191   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,194   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,196   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,198   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,199   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,201   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,203   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-01-21T23:19:45,206   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-01-21T23:19:45,208   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-01-21T23:19:45,209   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-01-21T23:19:45,211   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-01-21T23:19:45,214   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-01-21T23:19:45,217   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-01-21T23:19:45,218   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-01-21T23:19:45,220   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-01-21T23:19:45,222   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-01-21T23:19:45,224   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,226   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,227   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,229   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,231   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,233   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,235   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,236   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,238   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,240   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-01-21T23:19:45,242   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-01-21T23:19:45,243   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-01-21T23:19:45,246   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-01-21T23:19:45,247   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-01-21T23:19:45,250   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-01-21T23:19:45,252   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-01-21T23:19:45,254   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-01-21T23:19:45,256   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-01-21T23:19:45,258   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-01-21T23:19:45,259   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-01-21T23:19:45,262   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-01-21T23:19:45,264   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-01-21T23:19:45,268   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-01-21T23:19:45,269   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-01-21T23:19:45,271   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-01-21T23:19:45,272   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-01-21T23:19:45,274   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-01-21T23:19:45,276   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-01-21T23:19:45,278   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-01-21T23:19:45,280   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-01-21T23:19:45,281   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-01-21T23:19:45,283   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-01-21T23:19:45,284   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-01-21T23:19:45,286   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-01-21T23:19:45,288   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-01-21T23:19:45,289   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-01-21T23:19:45,292   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-01-21T23:19:45,294   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-01-21T23:19:45,296   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-01-21T23:19:45,298   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-01-21T23:19:45,300   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-01-21T23:19:45,302   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-01-21T23:19:45,304   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,305   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,307   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,309   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,311   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,313   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,314   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,316   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,318   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,320   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,322   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,324   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,326   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,328   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,329   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,331   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,333   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,335   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-01-21T23:19:45,338   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-01-21T23:19:45,339   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-01-21T23:19:45,342   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-01-21T23:19:45,343   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-01-21T23:19:45,345   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-01-21T23:19:45,347   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-01-21T23:19:45,349   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-01-21T23:19:45,351   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-01-21T23:19:45,354   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-01-21T23:19:45,356   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-01-21T23:19:45,357   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-01-21T23:19:45,359   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-01-21T23:19:45,362   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-01-21T23:19:45,364   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:45,366   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:45,368   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:45,371   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:45,373   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:45,376   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:45,380   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:45,381   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:45,383   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:45,386   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:45,388   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-01-21T23:19:45,390   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-01-21T23:19:45,394   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:45,396   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:45,398   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:45,401   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:45,404   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:45,407   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:45,410   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:45,412   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-01-21T23:19:45,415   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:45,417   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:45,419   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:45,421   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:45,424   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:45,426   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:45,430   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:45,433   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-01-21T23:19:45,436   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-01-21T23:19:45,437   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-01-21T23:19:45,440   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-01-21T23:19:45,442   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-01-21T23:19:45,444   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-01-21T23:19:45,446   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-01-21T23:19:45,449   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-01-21T23:19:45,452   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-01-21T23:19:45,455   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-01-21T23:19:45,457   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-01-21T23:19:45,459   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-01-21T23:19:45,462   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-01-21T23:19:45,463   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-01-21T23:19:45,466   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-01-21T23:19:45,468   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-01-21T23:19:45,470   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-01-21T23:19:45,471   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-01-21T23:19:45,474   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-01-21T23:19:45,475   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-01-21T23:19:45,477   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-01-21T23:19:45,480   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-01-21T23:19:45,482   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-01-21T23:19:45,484   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-01-21T23:19:45,486   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-01-21T23:19:45,488   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-01-21T23:19:45,489   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-01-21T23:19:45,491   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-01-21T23:19:45,494   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-01-21T23:19:45,495   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-01-21T23:19:45,498   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-01-21T23:19:45,499   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-01-21T23:19:45,501   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:45,502   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:45,505   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:45,507   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:45,509   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-01-21T23:19:45,512   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-01-21T23:19:45,513   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-01-21T23:19:45,516   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-01-21T23:19:45,517   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-01-21T23:19:45,519   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-01-21T23:19:45,521   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-01-21T23:19:45,522   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-01-21T23:19:45,525   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-01-21T23:19:45,527   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-01-21T23:19:45,530   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-01-21T23:19:45,531   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-01-21T23:19:45,534   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:45,535   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:45,538   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:45,540   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:45,542   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:45,544   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-01-21T23:19:45,547   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-01-21T23:19:45,548   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-01-21T23:19:45,551   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-01-21T23:19:45,553   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:45,554   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:45,557   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:45,559   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:45,562   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-01-21T23:19:45,564   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-01-21T23:19:45,565   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-01-21T23:19:45,568   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-01-21T23:19:45,569   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-01-21T23:19:45,571   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,573   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,576   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,578   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,581   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,584   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,587   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-01-21T23:19:45,589   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,590   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,593   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,596   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,598   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,602   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,605   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,607   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,609   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,611   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,613   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-01-21T23:19:45,617   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-01-21T23:19:45,618   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-01-21T23:19:45,621   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-01-21T23:19:45,623   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-01-21T23:19:45,625   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,628   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,631   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-01-21T23:19:45,634   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-01-21T23:19:45,635   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-01-21T23:19:45,638   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-01-21T23:19:45,641   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-01-21T23:19:45,642   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-01-21T23:19:45,644   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-01-21T23:19:45,647   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-01-21T23:19:45,648   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,650   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,652   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,654   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,656   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,659   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,661   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,663   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,665   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,667   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,670   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,672   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,674   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,676   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,678   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,680   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,681   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,683   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,685   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,687   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,689   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,691   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,694   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,695   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,698   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,700   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,702   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,705   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,707   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-01-21T23:19:45,710   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-01-21T23:19:45,711   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-01-21T23:19:45,714   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-01-21T23:19:45,716   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:45,717   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:45,720   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:45,722   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:45,724   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:45,727   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:45,729   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-01-21T23:19:45,731   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-01-21T23:19:45,732   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-01-21T23:19:45,735   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-01-21T23:19:45,737   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-01-21T23:19:45,738   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-01-21T23:19:45,740   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-01-21T23:19:45,742   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-01-21T23:19:45,743   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-01-21T23:19:45,745   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-01-21T23:19:45,747   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-01-21T23:19:45,749   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-01-21T23:19:45,752   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-01-21T23:19:45,753   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-01-21T23:19:45,755   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-01-21T23:19:45,757   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-01-21T23:19:45,759   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-01-21T23:19:45,762   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-01-21T23:19:45,764   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-01-21T23:19:45,766   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-01-21T23:19:45,768   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-01-21T23:19:45,770   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-01-21T23:19:45,772   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-01-21T23:19:45,774   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-01-21T23:19:45,776   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-01-21T23:19:45,778   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-01-21T23:19:45,781   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-01-21T23:19:45,782   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,784   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,786   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-01-21T23:19:45,788   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-01-21T23:19:45,790   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-01-21T23:19:45,792   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-01-21T23:19:45,794   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-01-21T23:19:45,799   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-01-21T23:19:45,801   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-01-21T23:19:45,803   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,806   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,807   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,809   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,811   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,813   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,815   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,817   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,820   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,821   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,823   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,825   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,827   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,829   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,832   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,834   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,836   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,837   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-01-21T23:19:45,839   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,841   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,844   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-01-21T23:19:45,845   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-01-21T23:19:45,847   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-01-21T23:19:45,849   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-01-21T23:19:45,851   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-01-21T23:19:45,853   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-01-21T23:19:45,854   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-01-21T23:19:45,856   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,858   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,860   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,861   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,863   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,865   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,866   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,868   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,871   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,872   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,874   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,876   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,878   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,879   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,881   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,883   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,885   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,886   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,888   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-01-21T23:19:45,891   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-01-21T23:19:45,892   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-01-21T23:19:45,894   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-01-21T23:19:45,896   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-01-21T23:19:45,898   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-01-21T23:19:45,900   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-01-21T23:19:45,902   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-01-21T23:19:45,903   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-01-21T23:19:45,905   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,907   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,909   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,911   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-01-21T23:19:45,913   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-01-21T23:19:45,914   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-01-21T23:19:45,918   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-01-21T23:19:45,919   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:45,921   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:45,924   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,926   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,927   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,930   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,932   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,935   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,937   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,939   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,941   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,943   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,946   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-01-21T23:19:45,947   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:45,950   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,952   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,954   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,956   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,958   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,960   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,962   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,964   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,966   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,967   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,969   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,971   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,973   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,975   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,976   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,978   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,981   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,983   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,985   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,987   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,989   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,991   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,993   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,995   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-01-21T23:19:45,997   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:45,999   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:46,001   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:46,003   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:46,005   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:46,007   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:46,009   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-01-21T23:19:46,012   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-01-21T23:19:46,015   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-01-21T23:19:46,016   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-01-21T23:19:46,018   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-01-21T23:19:46,020   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-01-21T23:19:46,021   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-01-21T23:19:46,024   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-01-21T23:19:46,025   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-01-21T23:19:46,028   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-01-21T23:19:46,031   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-01-21T23:19:46,034   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:46,035   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:46,037   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:46,039   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:46,041   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-01-21T23:19:46,043   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-01-21T23:19:46,046   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-01-21T23:19:46,048   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-01-21T23:19:46,050   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-01-21T23:19:46,052   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-01-21T23:19:46,055   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-01-21T23:19:46,056   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-01-21T23:19:46,058   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-01-21T23:19:46,060   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-01-21T23:19:46,062   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-01-21T23:19:46,064   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-01-21T23:19:46,066   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-01-21T23:19:46,069   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-01-21T23:19:46,071   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-01-21T23:19:46,073   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-01-21T23:19:46,075   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,077   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,080   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,082   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,084   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,086   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,089   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,091   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,094   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,095   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-01-21T23:19:46,098   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-01-21T23:19:46,100   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,102   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,106   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,113   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-01-21T23:19:46,115   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,117   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,119   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,121   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,124   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,127   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,131   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,136   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,141   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,147   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,154   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-01-21T23:19:46,155   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-01-21T23:19:46,158   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-01-21T23:19:46,160   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-01-21T23:19:46,162   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-01-21T23:19:46,164   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-01-21T23:19:46,166   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-01-21T23:19:46,168   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-01-21T23:19:46,169   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,171   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,173   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,176   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,177   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,179   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,181   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,183   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,185   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-01-21T23:19:46,188   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,190   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,192   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,195   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,197   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,200   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,202   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,204   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,206   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,208   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-01-21T23:19:46,211   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-01-21T23:19:46,212   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,214   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,216   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,218   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,220   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,222   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,224   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,226   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,228   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,230   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,232   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,234   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-01-21T23:19:46,236   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-01-21T23:19:46,237   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-01-21T23:19:46,240   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-01-21T23:19:46,243   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-01-21T23:19:46,244   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-01-21T23:19:46,246   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-01-21T23:19:46,249   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-01-21T23:19:46,251   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-01-21T23:19:46,253   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-01-21T23:19:46,256   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-01-21T23:19:46,257   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,259   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,262   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-01-21T23:19:46,263   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-01-21T23:19:46,266   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-01-21T23:19:46,268   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-01-21T23:19:46,271   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-01-21T23:19:46,272   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-01-21T23:19:46,274   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-01-21T23:19:46,276   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-01-21T23:19:46,278   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-01-21T23:19:46,280   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-01-21T23:19:46,281   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-01-21T23:19:46,283   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-01-21T23:19:46,285   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,287   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,289   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,291   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,293   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,295   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,297   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,299   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,301   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-01-21T23:19:46,303   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-01-21T23:19:46,305   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-01-21T23:19:46,307   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-01-21T23:19:46,308   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-01-21T23:19:46,310   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-01-21T23:19:46,312   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-01-21T23:19:46,315   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-01-21T23:19:46,316   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-01-21T23:19:46,318   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-01-21T23:19:46,320   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-01-21T23:19:46,322   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-01-21T23:19:46,323   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-01-21T23:19:46,326   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-01-21T23:19:46,328   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-01-21T23:19:46,329   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-01-21T23:19:46,331   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-01-21T23:19:46,334   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-01-21T23:19:46,335   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-01-21T23:19:46,338   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-01-21T23:19:46,340   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-01-21T23:19:46,342   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-01-21T23:19:46,343   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-01-21T23:19:46,346   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-01-21T23:19:46,348   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-01-21T23:19:46,349   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-01-21T23:19:46,352   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-01-21T23:19:46,353   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,355   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,358   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-01-21T23:19:46,360   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-01-21T23:19:46,362   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:46,363   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:46,365   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:46,367   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:46,369   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:46,371   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-01-21T23:19:46,373   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-01-21T23:19:46,375   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-01-21T23:19:46,377   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:46,379   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:46,381   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:46,382   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:46,385   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:46,387   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:46,389   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-01-21T23:19:46,391   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-01-21T23:19:46,393   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-01-21T23:19:46,394   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-01-21T23:19:46,397   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-01-21T23:19:46,399   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:46,400   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:46,402   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:46,404   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:46,406   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-01-21T23:19:46,408   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-01-21T23:19:46,411   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:46,412   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:46,414   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:46,416   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:46,418   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:46,420   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:46,422   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-01-21T23:19:46,424   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:46,426   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:46,427   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:46,429   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:46,431   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:46,433   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:46,435   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-01-21T23:19:46,437   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:46,439   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:46,441   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:46,443   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:46,445   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:46,447   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:46,449   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-01-21T23:19:46,451   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:46,452   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:46,454   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:46,456   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:46,458   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:46,460   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:46,462   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-01-21T23:19:46,464   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-01-21T23:19:46,466   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-01-21T23:19:46,468   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-01-21T23:19:46,470   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-01-21T23:19:46,472   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,473   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,475   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,477   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,479   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,481   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,483   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,486   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,487   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-01-21T23:19:46,490   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-01-21T23:19:46,491   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-01-21T23:19:46,493   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-01-21T23:19:46,496   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:46,497   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:46,499   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:46,501   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:46,503   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:46,505   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:46,506   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-01-21T23:19:46,509   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:46,510   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:46,512   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:46,514   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:46,516   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:46,518   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:46,520   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-01-21T23:19:46,522   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:46,523   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:46,526   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:46,528   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:46,530   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:46,533   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-01-21T23:19:46,535   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-01-21T23:19:46,538   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-01-21T23:19:46,539   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-01-21T23:19:46,542   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:46,543   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:46,545   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:46,547   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:46,549   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:46,551   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-01-21T23:19:46,553   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:46,554   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:46,557   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:46,559   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:46,560   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-01-21T23:19:46,563   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:46,565   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:46,567   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:46,570   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:46,572   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:46,574   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:46,576   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:46,578   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-01-21T23:19:46,580   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:46,581   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:46,583   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:46,585   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:46,587   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:46,590   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-01-21T23:19:46,592   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:46,594   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,596   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,598   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,600   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,602   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,604   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,607   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,609   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,611   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,614   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-01-21T23:19:46,616   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:46,619   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:46,620   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:46,623   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:46,625   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:46,627   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-01-21T23:19:46,629   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,631   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,633   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,635   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,636   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,638   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,640   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,643   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,645   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-01-21T23:19:46,646   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-01-21T23:19:46,649   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-01-21T23:19:46,651   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-01-21T23:19:46,652   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-01-21T23:19:46,654   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-01-21T23:19:46,656   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-01-21T23:19:46,659   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-01-21T23:19:46,662   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-01-21T23:19:46,664   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-01-21T23:19:46,666   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-01-21T23:19:46,669   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-01-21T23:19:46,671   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-01-21T23:19:46,672   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-01-21T23:19:46,674   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-01-21T23:19:46,677   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-01-21T23:19:46,678   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-01-21T23:19:46,682   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:46,683   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:46,685   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:46,687   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:46,689   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-01-21T23:19:46,692   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:46,693   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:46,695   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:46,697   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:46,699   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-01-21T23:19:46,702   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:46,703   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:46,706   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:46,707   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:46,710   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-01-21T23:19:46,712   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-01-21T23:19:46,714   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-01-21T23:19:46,717   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,719   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,721   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,723   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,725   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,727   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,729   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,731   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,732   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,734   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-01-21T23:19:46,736   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-01-21T23:19:46,740   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:46,741   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:46,743   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:46,745   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:46,747   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-01-21T23:19:46,749   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-01-21T23:19:46,752   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:46,754   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:46,756   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:46,758   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:46,760   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-01-21T23:19:46,763   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:46,764   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:46,766   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:46,768   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:46,770   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-01-21T23:19:46,773   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:46,774   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:46,776   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:46,778   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:46,780   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-01-21T23:19:46,782   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:46,783   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:46,785   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:46,787   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:46,789   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-01-21T23:19:46,791   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-01-21T23:19:46,794   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:46,795   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:46,797   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:46,799   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:46,801   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-01-21T23:19:46,804   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,805   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,807   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,809   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,810   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,812   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,814   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,816   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,818   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,819   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-01-21T23:19:46,822   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:46,823   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:46,825   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:46,827   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:46,829   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-01-21T23:19:46,831   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-01-21T23:19:46,833   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,835   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,837   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,839   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,842   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-01-21T23:19:46,843   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-01-21T23:19:46,845   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-01-21T23:19:46,847   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-01-21T23:19:46,849   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-01-21T23:19:46,851   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-01-21T23:19:46,853   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-01-21T23:19:46,855   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-01-21T23:19:46,858   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-01-21T23:19:46,859   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,861   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,863   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,866   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,868   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,870   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,873   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,875   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,877   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,879   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-01-21T23:19:46,882   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-01-21T23:19:46,883   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-01-21T23:19:46,885   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-01-21T23:19:46,888   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-01-21T23:19:46,890   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-01-21T23:19:46,892   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-01-21T23:19:46,895   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-01-21T23:19:46,897   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-01-21T23:19:46,898   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-01-21T23:19:46,901   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-01-21T23:19:46,902   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-01-21T23:19:46,905   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-01-21T23:19:46,907   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-01-21T23:19:46,909   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-01-21T23:19:46,911   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-01-21T23:19:46,914   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-01-21T23:19:46,915   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-01-21T23:19:46,917   running install_egg_info
2025-01-21T23:19:46,950   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.3-py3.11.egg-info
2025-01-21T23:19:46,963   running install_scripts
2025-01-21T23:19:46,965   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,966   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,968   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,970   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,971   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,973   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,975   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,976   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,978   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,979   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,981   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts
2025-01-21T23:19:46,983   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/ds_io to 755
2025-01-21T23:19:46,984   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/ds_report to 755
2025-01-21T23:19:46,984   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/ds_nvme_tune to 755
2025-01-21T23:19:46,985   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/ds_elastic to 755
2025-01-21T23:19:46,985   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/ds_ssh to 755
2025-01-21T23:19:46,986   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/deepspeed.pt to 755
2025-01-21T23:19:46,986   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/ds to 755
2025-01-21T23:19:46,987   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/dsr to 755
2025-01-21T23:19:46,987   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/deepspeed to 755
2025-01-21T23:19:46,988   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.data/scripts/ds_bench to 755
2025-01-21T23:19:47,036   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.3.dist-info/WHEEL
2025-01-21T23:19:47,038   creating '/tmp/pip-wheel-9e84u6r2/deepspeed-0.16.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-01-21T23:19:47,042   adding 'deepspeed/__init__.py'
2025-01-21T23:19:47,043   adding 'deepspeed/constants.py'
2025-01-21T23:19:47,045   adding 'deepspeed/env_report.py'
2025-01-21T23:19:47,046   adding 'deepspeed/git_version_info.py'
2025-01-21T23:19:47,048   adding 'deepspeed/git_version_info_installed.py'
2025-01-21T23:19:47,050   adding 'deepspeed/accelerator/__init__.py'
2025-01-21T23:19:47,051   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-01-21T23:19:47,053   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-01-21T23:19:47,056   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-01-21T23:19:47,057   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-01-21T23:19:47,059   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-01-21T23:19:47,061   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-01-21T23:19:47,062   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-01-21T23:19:47,064   adding 'deepspeed/accelerator/real_accelerator.py'
2025-01-21T23:19:47,066   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-01-21T23:19:47,068   adding 'deepspeed/autotuning/__init__.py'
2025-01-21T23:19:47,073   adding 'deepspeed/autotuning/autotuner.py'
2025-01-21T23:19:47,074   adding 'deepspeed/autotuning/config.py'
2025-01-21T23:19:47,076   adding 'deepspeed/autotuning/constants.py'
2025-01-21T23:19:47,078   adding 'deepspeed/autotuning/scheduler.py'
2025-01-21T23:19:47,080   adding 'deepspeed/autotuning/utils.py'
2025-01-21T23:19:47,082   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-01-21T23:19:47,083   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-01-21T23:19:47,084   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-01-21T23:19:47,085   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-01-21T23:19:47,087   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-01-21T23:19:47,088   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-01-21T23:19:47,089   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-01-21T23:19:47,091   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-01-21T23:19:47,092   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-01-21T23:19:47,093   adding 'deepspeed/autotuning/tuner/utils.py'
2025-01-21T23:19:47,095   adding 'deepspeed/checkpoint/__init__.py'
2025-01-21T23:19:47,096   adding 'deepspeed/checkpoint/constants.py'
2025-01-21T23:19:47,098   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-01-21T23:19:47,101   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-01-21T23:19:47,102   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-01-21T23:19:47,104   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-01-21T23:19:47,106   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-01-21T23:19:47,107   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-01-21T23:19:47,109   adding 'deepspeed/checkpoint/utils.py'
2025-01-21T23:19:47,110   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-01-21T23:19:47,112   adding 'deepspeed/comm/__init__.py'
2025-01-21T23:19:47,113   adding 'deepspeed/comm/backend.py'
2025-01-21T23:19:47,115   adding 'deepspeed/comm/ccl.py'
2025-01-21T23:19:47,118   adding 'deepspeed/comm/comm.py'
2025-01-21T23:19:47,120   adding 'deepspeed/comm/config.py'
2025-01-21T23:19:47,121   adding 'deepspeed/comm/constants.py'
2025-01-21T23:19:47,122   adding 'deepspeed/comm/reduce_op.py'
2025-01-21T23:19:47,124   adding 'deepspeed/comm/torch.py'
2025-01-21T23:19:47,126   adding 'deepspeed/comm/utils.py'
2025-01-21T23:19:47,127   adding 'deepspeed/compression/__init__.py'
2025-01-21T23:19:47,130   adding 'deepspeed/compression/basic_layer.py'
2025-01-21T23:19:47,132   adding 'deepspeed/compression/compress.py'
2025-01-21T23:19:47,135   adding 'deepspeed/compression/config.py'
2025-01-21T23:19:47,136   adding 'deepspeed/compression/constants.py'
2025-01-21T23:19:47,138   adding 'deepspeed/compression/helper.py'
2025-01-21T23:19:47,140   adding 'deepspeed/compression/scheduler.py'
2025-01-21T23:19:47,141   adding 'deepspeed/compression/utils.py'
2025-01-21T23:19:47,143   adding 'deepspeed/elasticity/__init__.py'
2025-01-21T23:19:47,144   adding 'deepspeed/elasticity/config.py'
2025-01-21T23:19:47,146   adding 'deepspeed/elasticity/constants.py'
2025-01-21T23:19:47,147   adding 'deepspeed/elasticity/elastic_agent.py'
2025-01-21T23:19:47,150   adding 'deepspeed/elasticity/elasticity.py'
2025-01-21T23:19:47,151   adding 'deepspeed/elasticity/utils.py'
2025-01-21T23:19:47,153   adding 'deepspeed/inference/__init__.py'
2025-01-21T23:19:47,155   adding 'deepspeed/inference/config.py'
2025-01-21T23:19:47,158   adding 'deepspeed/inference/engine.py'
2025-01-21T23:19:47,160   adding 'deepspeed/inference/quantization/__init__.py'
2025-01-21T23:19:47,162   adding 'deepspeed/inference/quantization/layers.py'
2025-01-21T23:19:47,163   adding 'deepspeed/inference/quantization/quantization.py'
2025-01-21T23:19:47,164   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-01-21T23:19:47,166   adding 'deepspeed/inference/quantization/utils.py'
2025-01-21T23:19:47,168   adding 'deepspeed/inference/v2/__init__.py'
2025-01-21T23:19:47,169   adding 'deepspeed/inference/v2/allocator.py'
2025-01-21T23:19:47,170   adding 'deepspeed/inference/v2/config_v2.py'
2025-01-21T23:19:47,172   adding 'deepspeed/inference/v2/engine_factory.py'
2025-01-21T23:19:47,174   adding 'deepspeed/inference/v2/engine_v2.py'
2025-01-21T23:19:47,175   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-01-21T23:19:47,176   adding 'deepspeed/inference/v2/inference_utils.py'
2025-01-21T23:19:47,177   adding 'deepspeed/inference/v2/logging.py'
2025-01-21T23:19:47,179   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-01-21T23:19:47,180   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-01-21T23:19:47,181   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-01-21T23:19:47,183   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-01-21T23:19:47,184   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-01-21T23:19:47,186   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-01-21T23:19:47,187   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-01-21T23:19:47,189   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-01-21T23:19:47,190   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-01-21T23:19:47,192   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-01-21T23:19:47,193   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-01-21T23:19:47,194   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-01-21T23:19:47,195   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-01-21T23:19:47,197   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-01-21T23:19:47,199   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-01-21T23:19:47,200   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-01-21T23:19:47,201   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-01-21T23:19:47,203   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-01-21T23:19:47,205   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-01-21T23:19:47,206   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-01-21T23:19:47,207   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-01-21T23:19:47,208   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-01-21T23:19:47,210   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-01-21T23:19:47,211   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-01-21T23:19:47,212   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-01-21T23:19:47,214   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-01-21T23:19:47,216   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-01-21T23:19:47,218   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-01-21T23:19:47,219   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-01-21T23:19:47,221   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-01-21T23:19:47,223   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-01-21T23:19:47,224   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-01-21T23:19:47,226   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-01-21T23:19:47,228   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-01-21T23:19:47,230   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-01-21T23:19:47,231   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-01-21T23:19:47,232   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-01-21T23:19:47,234   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-01-21T23:19:47,236   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-01-21T23:19:47,237   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-01-21T23:19:47,239   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-01-21T23:19:47,240   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-01-21T23:19:47,242   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-01-21T23:19:47,243   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-01-21T23:19:47,244   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-01-21T23:19:47,246   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-01-21T23:19:47,247   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-01-21T23:19:47,248   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-01-21T23:19:47,250   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-01-21T23:19:47,251   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-01-21T23:19:47,253   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-01-21T23:19:47,254   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-01-21T23:19:47,255   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-01-21T23:19:47,257   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-01-21T23:19:47,258   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-01-21T23:19:47,260   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-01-21T23:19:47,262   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-01-21T23:19:47,263   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-01-21T23:19:47,264   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-01-21T23:19:47,266   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-01-21T23:19:47,267   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-01-21T23:19:47,269   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-01-21T23:19:47,270   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-01-21T23:19:47,271   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-01-21T23:19:47,273   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-01-21T23:19:47,274   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-01-21T23:19:47,276   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-01-21T23:19:47,278   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-01-21T23:19:47,279   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-01-21T23:19:47,281   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-01-21T23:19:47,283   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-01-21T23:19:47,286   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-01-21T23:19:47,287   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-01-21T23:19:47,289   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-01-21T23:19:47,290   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-01-21T23:19:47,292   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-01-21T23:19:47,293   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-01-21T23:19:47,294   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-01-21T23:19:47,295   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-01-21T23:19:47,297   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-01-21T23:19:47,298   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-01-21T23:19:47,299   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-01-21T23:19:47,300   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-01-21T23:19:47,302   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-01-21T23:19:47,303   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-01-21T23:19:47,305   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-01-21T23:19:47,306   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-01-21T23:19:47,307   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-01-21T23:19:47,308   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-01-21T23:19:47,310   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-01-21T23:19:47,311   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-01-21T23:19:47,313   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-01-21T23:19:47,315   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-01-21T23:19:47,316   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-01-21T23:19:47,317   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-01-21T23:19:47,319   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-01-21T23:19:47,321   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-01-21T23:19:47,322   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-01-21T23:19:47,323   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-01-21T23:19:47,325   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-01-21T23:19:47,326   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-01-21T23:19:47,328   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-01-21T23:19:47,329   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-01-21T23:19:47,330   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-01-21T23:19:47,331   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-01-21T23:19:47,333   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-01-21T23:19:47,335   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-01-21T23:19:47,336   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-01-21T23:19:47,337   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-01-21T23:19:47,339   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-01-21T23:19:47,340   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-01-21T23:19:47,342   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-01-21T23:19:47,343   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-01-21T23:19:47,344   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-01-21T23:19:47,345   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-01-21T23:19:47,347   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-01-21T23:19:47,348   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-01-21T23:19:47,350   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-01-21T23:19:47,351   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-01-21T23:19:47,352   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-01-21T23:19:47,354   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-01-21T23:19:47,355   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-01-21T23:19:47,356   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-01-21T23:19:47,358   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-01-21T23:19:47,359   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-01-21T23:19:47,360   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-01-21T23:19:47,362   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-01-21T23:19:47,364   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-01-21T23:19:47,366   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-01-21T23:19:47,368   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-01-21T23:19:47,370   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-01-21T23:19:47,372   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-01-21T23:19:47,374   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-01-21T23:19:47,376   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-01-21T23:19:47,377   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-01-21T23:19:47,379   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-01-21T23:19:47,380   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-01-21T23:19:47,381   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-01-21T23:19:47,383   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-01-21T23:19:47,384   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-01-21T23:19:47,386   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-01-21T23:19:47,387   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-01-21T23:19:47,389   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-01-21T23:19:47,391   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-01-21T23:19:47,393   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-01-21T23:19:47,394   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-01-21T23:19:47,396   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-01-21T23:19:47,398   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-01-21T23:19:47,400   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-01-21T23:19:47,401   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-01-21T23:19:47,403   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-01-21T23:19:47,405   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-01-21T23:19:47,407   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-01-21T23:19:47,408   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-01-21T23:19:47,410   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-01-21T23:19:47,411   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-01-21T23:19:47,414   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-01-21T23:19:47,415   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-01-21T23:19:47,417   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-01-21T23:19:47,419   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-01-21T23:19:47,421   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-01-21T23:19:47,422   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-01-21T23:19:47,424   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-01-21T23:19:47,425   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-01-21T23:19:47,427   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-01-21T23:19:47,428   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-01-21T23:19:47,430   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-01-21T23:19:47,431   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-01-21T23:19:47,433   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-01-21T23:19:47,434   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-01-21T23:19:47,435   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-01-21T23:19:47,437   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-01-21T23:19:47,438   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-01-21T23:19:47,440   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-01-21T23:19:47,441   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-01-21T23:19:47,443   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-01-21T23:19:47,444   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-01-21T23:19:47,446   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-01-21T23:19:47,447   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-01-21T23:19:47,449   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-01-21T23:19:47,451   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-01-21T23:19:47,452   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-01-21T23:19:47,454   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-01-21T23:19:47,455   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-01-21T23:19:47,456   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-01-21T23:19:47,458   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-01-21T23:19:47,459   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-01-21T23:19:47,461   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-01-21T23:19:47,462   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-01-21T23:19:47,463   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-01-21T23:19:47,465   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-01-21T23:19:47,466   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-01-21T23:19:47,468   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-01-21T23:19:47,469   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-01-21T23:19:47,470   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-01-21T23:19:47,472   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-01-21T23:19:47,473   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-01-21T23:19:47,475   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-01-21T23:19:47,476   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-01-21T23:19:47,477   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-01-21T23:19:47,478   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-01-21T23:19:47,479   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-01-21T23:19:47,481   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-01-21T23:19:47,483   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-01-21T23:19:47,484   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-01-21T23:19:47,486   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-01-21T23:19:47,487   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-01-21T23:19:47,489   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-01-21T23:19:47,490   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-01-21T23:19:47,491   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-01-21T23:19:47,493   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-01-21T23:19:47,495   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-01-21T23:19:47,497   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-01-21T23:19:47,498   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-01-21T23:19:47,500   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-01-21T23:19:47,501   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-01-21T23:19:47,503   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-01-21T23:19:47,504   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-01-21T23:19:47,506   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-01-21T23:19:47,508   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-01-21T23:19:47,509   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-01-21T23:19:47,511   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-01-21T23:19:47,512   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-01-21T23:19:47,513   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-01-21T23:19:47,515   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-01-21T23:19:47,516   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-01-21T23:19:47,517   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-01-21T23:19:47,519   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-01-21T23:19:47,521   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-01-21T23:19:47,522   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-01-21T23:19:47,524   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-01-21T23:19:47,526   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-01-21T23:19:47,528   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-01-21T23:19:47,530   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-01-21T23:19:47,531   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-01-21T23:19:47,533   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-01-21T23:19:47,534   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-01-21T23:19:47,536   adding 'deepspeed/launcher/__init__.py'
2025-01-21T23:19:47,537   adding 'deepspeed/launcher/constants.py'
2025-01-21T23:19:47,539   adding 'deepspeed/launcher/launch.py'
2025-01-21T23:19:47,541   adding 'deepspeed/launcher/launcher_helper.py'
2025-01-21T23:19:47,543   adding 'deepspeed/launcher/multinode_runner.py'
2025-01-21T23:19:47,546   adding 'deepspeed/launcher/runner.py'
2025-01-21T23:19:47,547   adding 'deepspeed/linear/__init__.py'
2025-01-21T23:19:47,549   adding 'deepspeed/linear/config.py'
2025-01-21T23:19:47,550   adding 'deepspeed/linear/context_manager.py'
2025-01-21T23:19:47,552   adding 'deepspeed/linear/optimized_linear.py'
2025-01-21T23:19:47,553   adding 'deepspeed/linear/quantization.py'
2025-01-21T23:19:47,555   adding 'deepspeed/model_implementations/__init__.py'
2025-01-21T23:19:47,556   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-01-21T23:19:47,558   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-01-21T23:19:47,559   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-01-21T23:19:47,560   adding 'deepspeed/model_implementations/features/__init__.py'
2025-01-21T23:19:47,562   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-01-21T23:19:47,564   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-01-21T23:19:47,565   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-01-21T23:19:47,566   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-01-21T23:19:47,567   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-01-21T23:19:47,568   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-01-21T23:19:47,570   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-01-21T23:19:47,571   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-01-21T23:19:47,572   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-01-21T23:19:47,573   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-01-21T23:19:47,575   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-01-21T23:19:47,577   adding 'deepspeed/module_inject/__init__.py'
2025-01-21T23:19:47,580   adding 'deepspeed/module_inject/auto_tp.py'
2025-01-21T23:19:47,582   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-01-21T23:19:47,584   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-01-21T23:19:47,585   adding 'deepspeed/module_inject/inject.py'
2025-01-21T23:19:47,587   adding 'deepspeed/module_inject/layers.py'
2025-01-21T23:19:47,589   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-01-21T23:19:47,590   adding 'deepspeed/module_inject/module_quantize.py'
2025-01-21T23:19:47,592   adding 'deepspeed/module_inject/policy.py'
2025-01-21T23:19:47,596   adding 'deepspeed/module_inject/replace_module.py'
2025-01-21T23:19:47,597   adding 'deepspeed/module_inject/replace_policy.py'
2025-01-21T23:19:47,599   adding 'deepspeed/module_inject/tp_shard.py'
2025-01-21T23:19:47,600   adding 'deepspeed/module_inject/utils.py'
2025-01-21T23:19:47,602   adding 'deepspeed/module_inject/containers/__init__.py'
2025-01-21T23:19:47,604   adding 'deepspeed/module_inject/containers/base.py'
2025-01-21T23:19:47,606   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-01-21T23:19:47,607   adding 'deepspeed/module_inject/containers/bert.py'
2025-01-21T23:19:47,608   adding 'deepspeed/module_inject/containers/bloom.py'
2025-01-21T23:19:47,610   adding 'deepspeed/module_inject/containers/clip.py'
2025-01-21T23:19:47,611   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-01-21T23:19:47,613   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-01-21T23:19:47,614   adding 'deepspeed/module_inject/containers/gptj.py'
2025-01-21T23:19:47,616   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-01-21T23:19:47,618   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-01-21T23:19:47,619   adding 'deepspeed/module_inject/containers/internlm.py'
2025-01-21T23:19:47,621   adding 'deepspeed/module_inject/containers/llama.py'
2025-01-21T23:19:47,622   adding 'deepspeed/module_inject/containers/llama2.py'
2025-01-21T23:19:47,623   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-01-21T23:19:47,625   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-01-21T23:19:47,626   adding 'deepspeed/module_inject/containers/opt.py'
2025-01-21T23:19:47,627   adding 'deepspeed/module_inject/containers/unet.py'
2025-01-21T23:19:47,629   adding 'deepspeed/module_inject/containers/vae.py'
2025-01-21T23:19:47,630   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-01-21T23:19:47,632   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-01-21T23:19:47,633   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-01-21T23:19:47,635   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-01-21T23:19:47,636   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-01-21T23:19:47,637   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-01-21T23:19:47,639   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-01-21T23:19:47,641   adding 'deepspeed/moe/__init__.py'
2025-01-21T23:19:47,642   adding 'deepspeed/moe/experts.py'
2025-01-21T23:19:47,643   adding 'deepspeed/moe/layer.py'
2025-01-21T23:19:47,645   adding 'deepspeed/moe/mappings.py'
2025-01-21T23:19:47,648   adding 'deepspeed/moe/sharded_moe.py'
2025-01-21T23:19:47,650   adding 'deepspeed/moe/utils.py'
2025-01-21T23:19:47,651   adding 'deepspeed/monitor/__init__.py'
2025-01-21T23:19:47,653   adding 'deepspeed/monitor/comet.py'
2025-01-21T23:19:47,654   adding 'deepspeed/monitor/config.py'
2025-01-21T23:19:47,656   adding 'deepspeed/monitor/csv_monitor.py'
2025-01-21T23:19:47,657   adding 'deepspeed/monitor/monitor.py'
2025-01-21T23:19:47,658   adding 'deepspeed/monitor/tensorboard.py'
2025-01-21T23:19:47,659   adding 'deepspeed/monitor/utils.py'
2025-01-21T23:19:47,661   adding 'deepspeed/monitor/wandb.py'
2025-01-21T23:19:47,662   adding 'deepspeed/nebula/__init__.py'
2025-01-21T23:19:47,663   adding 'deepspeed/nebula/config.py'
2025-01-21T23:19:47,665   adding 'deepspeed/nebula/constants.py'
2025-01-21T23:19:47,667   adding 'deepspeed/nvme/__init__.py'
2025-01-21T23:19:47,668   adding 'deepspeed/nvme/ds_aio_args.py'
2025-01-21T23:19:47,670   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-01-21T23:19:47,671   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-01-21T23:19:47,672   adding 'deepspeed/nvme/ds_aio_job.py'
2025-01-21T23:19:47,674   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-01-21T23:19:47,675   adding 'deepspeed/nvme/perf_generate_param.py'
2025-01-21T23:19:47,677   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-01-21T23:19:47,678   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-01-21T23:19:47,679   adding 'deepspeed/nvme/test_ds_aio.py'
2025-01-21T23:19:47,681   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-01-21T23:19:47,682   adding 'deepspeed/nvme/validate_async_io.py'
2025-01-21T23:19:47,684   adding 'deepspeed/ops/__init__.py'
2025-01-21T23:19:47,686   adding 'deepspeed/ops/adagrad/__init__.py'
2025-01-21T23:19:47,687   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-01-21T23:19:47,689   adding 'deepspeed/ops/adam/__init__.py'
2025-01-21T23:19:47,691   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-01-21T23:19:47,692   adding 'deepspeed/ops/adam/fused_adam.py'
2025-01-21T23:19:47,694   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-01-21T23:19:47,695   adding 'deepspeed/ops/aio/__init__.py'
2025-01-21T23:19:47,698   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-01-21T23:19:47,700   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-01-21T23:19:47,701   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-01-21T23:19:47,703   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-01-21T23:19:47,704   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-01-21T23:19:47,706   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-01-21T23:19:47,708   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-01-21T23:19:47,709   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-01-21T23:19:47,711   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-01-21T23:19:47,712   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-01-21T23:19:47,713   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-01-21T23:19:47,715   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-01-21T23:19:47,717   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-01-21T23:19:47,718   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-01-21T23:19:47,719   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-01-21T23:19:47,720   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-01-21T23:19:47,722   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-01-21T23:19:47,723   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-01-21T23:19:47,724   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-01-21T23:19:47,726   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-01-21T23:19:47,727   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-01-21T23:19:47,728   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-01-21T23:19:47,729   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-01-21T23:19:47,731   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-01-21T23:19:47,732   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-01-21T23:19:47,733   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-01-21T23:19:47,735   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-01-21T23:19:47,737   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-01-21T23:19:47,738   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-01-21T23:19:47,740   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-01-21T23:19:47,742   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-01-21T23:19:47,745   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-01-21T23:19:47,748   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-01-21T23:19:47,749   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-01-21T23:19:47,751   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-01-21T23:19:47,753   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-01-21T23:19:47,755   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-01-21T23:19:47,757   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-01-21T23:19:47,758   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-01-21T23:19:47,760   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-01-21T23:19:47,768   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-01-21T23:19:47,774   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-01-21T23:19:47,776   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-01-21T23:19:47,779   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-01-21T23:19:47,781   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-01-21T23:19:47,782   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-01-21T23:19:47,785   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-01-21T23:19:47,786   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-01-21T23:19:47,789   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-01-21T23:19:47,791   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-01-21T23:19:47,793   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-01-21T23:19:47,795   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-01-21T23:19:47,802   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-01-21T23:19:47,806   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-01-21T23:19:47,807   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-01-21T23:19:47,812   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-01-21T23:19:47,816   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-01-21T23:19:47,820   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-01-21T23:19:47,821   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-01-21T23:19:47,823   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-01-21T23:19:47,825   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-01-21T23:19:47,827   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-01-21T23:19:47,829   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-01-21T23:19:47,831   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-01-21T23:19:47,833   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-01-21T23:19:47,835   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-01-21T23:19:47,837   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-01-21T23:19:47,839   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-01-21T23:19:47,840   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-01-21T23:19:47,842   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-01-21T23:19:47,843   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-01-21T23:19:47,844   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-01-21T23:19:47,846   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-01-21T23:19:47,848   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-01-21T23:19:47,849   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-01-21T23:19:47,850   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-01-21T23:19:47,852   adding 'deepspeed/ops/csrc/includes/context.h'
2025-01-21T23:19:47,854   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-01-21T23:19:47,856   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-01-21T23:19:47,857   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-01-21T23:19:47,859   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-01-21T23:19:47,861   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-01-21T23:19:47,863   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-01-21T23:19:47,864   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-01-21T23:19:47,866   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-01-21T23:19:47,867   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-01-21T23:19:47,868   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-01-21T23:19:47,870   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-01-21T23:19:47,871   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-01-21T23:19:47,873   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-01-21T23:19:47,874   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-01-21T23:19:47,876   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-01-21T23:19:47,878   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-01-21T23:19:47,879   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-01-21T23:19:47,881   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-01-21T23:19:47,882   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-01-21T23:19:47,885   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-01-21T23:19:47,886   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-01-21T23:19:47,887   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-01-21T23:19:47,889   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-01-21T23:19:47,890   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-01-21T23:19:47,892   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-01-21T23:19:47,894   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-01-21T23:19:47,896   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-01-21T23:19:47,897   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-01-21T23:19:47,899   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-01-21T23:19:47,900   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-01-21T23:19:47,901   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-01-21T23:19:47,903   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-01-21T23:19:47,906   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-01-21T23:19:47,908   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-01-21T23:19:47,911   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-01-21T23:19:47,912   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-01-21T23:19:47,914   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-01-21T23:19:47,916   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-01-21T23:19:47,918   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-01-21T23:19:47,920   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-01-21T23:19:47,921   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-01-21T23:19:47,923   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-01-21T23:19:47,925   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-01-21T23:19:47,927   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-01-21T23:19:47,929   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-01-21T23:19:47,931   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-01-21T23:19:47,933   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-01-21T23:19:47,935   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-01-21T23:19:47,939   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-01-21T23:19:47,941   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-01-21T23:19:47,943   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-01-21T23:19:47,947   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-01-21T23:19:47,950   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-01-21T23:19:47,952   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-01-21T23:19:47,955   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-01-21T23:19:47,956   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-01-21T23:19:47,959   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-01-21T23:19:47,961   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-01-21T23:19:47,963   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-01-21T23:19:47,968   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-01-21T23:19:47,970   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-01-21T23:19:47,972   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-01-21T23:19:47,975   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-01-21T23:19:47,977   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-01-21T23:19:47,980   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-01-21T23:19:47,982   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-01-21T23:19:47,983   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-01-21T23:19:47,985   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2025-01-21T23:19:47,987   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-01-21T23:19:47,989   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-01-21T23:19:47,991   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-01-21T23:19:47,992   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-01-21T23:19:47,994   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-01-21T23:19:47,996   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-01-21T23:19:47,997   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-01-21T23:19:47,999   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-01-21T23:19:48,000   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-01-21T23:19:48,002   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-01-21T23:19:48,004   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-01-21T23:19:48,005   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-01-21T23:19:48,007   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-01-21T23:19:48,008   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-01-21T23:19:48,009   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-01-21T23:19:48,011   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-01-21T23:19:48,013   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-01-21T23:19:48,014   adding 'deepspeed/ops/gds/__init__.py'
2025-01-21T23:19:48,016   adding 'deepspeed/ops/lamb/__init__.py'
2025-01-21T23:19:48,018   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-01-21T23:19:48,019   adding 'deepspeed/ops/lion/__init__.py'
2025-01-21T23:19:48,021   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-01-21T23:19:48,022   adding 'deepspeed/ops/lion/fused_lion.py'
2025-01-21T23:19:48,024   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-01-21T23:19:48,026   adding 'deepspeed/ops/op_builder/__init__.py'
2025-01-21T23:19:48,027   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-01-21T23:19:48,029   adding 'deepspeed/ops/op_builder/async_io.py'
2025-01-21T23:19:48,032   adding 'deepspeed/ops/op_builder/builder.py'
2025-01-21T23:19:48,034   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-01-21T23:19:48,035   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-01-21T23:19:48,036   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-01-21T23:19:48,038   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-01-21T23:19:48,039   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-01-21T23:19:48,040   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-01-21T23:19:48,041   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-01-21T23:19:48,043   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-01-21T23:19:48,044   adding 'deepspeed/ops/op_builder/gds.py'
2025-01-21T23:19:48,045   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-01-21T23:19:48,047   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-01-21T23:19:48,048   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-01-21T23:19:48,050   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-01-21T23:19:48,051   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-01-21T23:19:48,052   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-01-21T23:19:48,054   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-01-21T23:19:48,055   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-01-21T23:19:48,056   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-01-21T23:19:48,057   adding 'deepspeed/ops/op_builder/transformer.py'
2025-01-21T23:19:48,059   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-01-21T23:19:48,060   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-01-21T23:19:48,062   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-01-21T23:19:48,063   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-01-21T23:19:48,064   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-01-21T23:19:48,065   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-01-21T23:19:48,066   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-01-21T23:19:48,067   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-01-21T23:19:48,069   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-01-21T23:19:48,070   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-01-21T23:19:48,071   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-01-21T23:19:48,073   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-01-21T23:19:48,074   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-01-21T23:19:48,075   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-01-21T23:19:48,077   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-01-21T23:19:48,078   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-01-21T23:19:48,079   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-01-21T23:19:48,080   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-01-21T23:19:48,081   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-01-21T23:19:48,082   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-01-21T23:19:48,084   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-01-21T23:19:48,085   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-01-21T23:19:48,087   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-01-21T23:19:48,088   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-01-21T23:19:48,089   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-01-21T23:19:48,090   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-01-21T23:19:48,092   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-01-21T23:19:48,094   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-01-21T23:19:48,095   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-01-21T23:19:48,097   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-01-21T23:19:48,098   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-01-21T23:19:48,100   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-01-21T23:19:48,101   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-01-21T23:19:48,102   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-01-21T23:19:48,103   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-01-21T23:19:48,105   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-01-21T23:19:48,106   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-01-21T23:19:48,107   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-01-21T23:19:48,108   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-01-21T23:19:48,110   adding 'deepspeed/ops/quantizer/__init__.py'
2025-01-21T23:19:48,111   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-01-21T23:19:48,113   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-01-21T23:19:48,114   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-01-21T23:19:48,116   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-01-21T23:19:48,118   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-01-21T23:19:48,121   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-01-21T23:19:48,123   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-01-21T23:19:48,125   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-01-21T23:19:48,127   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-01-21T23:19:48,130   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-01-21T23:19:48,132   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-01-21T23:19:48,134   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-01-21T23:19:48,135   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-01-21T23:19:48,136   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-01-21T23:19:48,138   adding 'deepspeed/ops/transformer/__init__.py'
2025-01-21T23:19:48,140   adding 'deepspeed/ops/transformer/transformer.py'
2025-01-21T23:19:48,142   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-01-21T23:19:48,143   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-01-21T23:19:48,145   adding 'deepspeed/ops/transformer/inference/config.py'
2025-01-21T23:19:48,146   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-01-21T23:19:48,147   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-01-21T23:19:48,148   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-01-21T23:19:48,150   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-01-21T23:19:48,152   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-01-21T23:19:48,154   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-01-21T23:19:48,156   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-01-21T23:19:48,158   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-01-21T23:19:48,159   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-01-21T23:19:48,160   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-01-21T23:19:48,161   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-01-21T23:19:48,162   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-01-21T23:19:48,164   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-01-21T23:19:48,165   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-01-21T23:19:48,166   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-01-21T23:19:48,167   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-01-21T23:19:48,169   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-01-21T23:19:48,170   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-01-21T23:19:48,171   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-01-21T23:19:48,173   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-01-21T23:19:48,174   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-01-21T23:19:48,175   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-01-21T23:19:48,176   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-01-21T23:19:48,178   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-01-21T23:19:48,179   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-01-21T23:19:48,180   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-01-21T23:19:48,182   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-01-21T23:19:48,183   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-01-21T23:19:48,184   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-01-21T23:19:48,186   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-01-21T23:19:48,188   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-01-21T23:19:48,190   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-01-21T23:19:48,191   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-01-21T23:19:48,193   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-01-21T23:19:48,195   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-01-21T23:19:48,197   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-01-21T23:19:48,198   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-01-21T23:19:48,199   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-01-21T23:19:48,201   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-01-21T23:19:48,202   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-01-21T23:19:48,204   adding 'deepspeed/pipe/__init__.py'
2025-01-21T23:19:48,206   adding 'deepspeed/profiling/__init__.py'
2025-01-21T23:19:48,207   adding 'deepspeed/profiling/config.py'
2025-01-21T23:19:48,208   adding 'deepspeed/profiling/constants.py'
2025-01-21T23:19:48,210   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-01-21T23:19:48,215   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-01-21T23:19:48,217   adding 'deepspeed/runtime/__init__.py'
2025-01-21T23:19:48,218   adding 'deepspeed/runtime/base_optimizer.py'
2025-01-21T23:19:48,221   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-01-21T23:19:48,222   adding 'deepspeed/runtime/compiler.py'
2025-01-21T23:19:48,226   adding 'deepspeed/runtime/config.py'
2025-01-21T23:19:48,228   adding 'deepspeed/runtime/config_utils.py'
2025-01-21T23:19:48,230   adding 'deepspeed/runtime/constants.py'
2025-01-21T23:19:48,232   adding 'deepspeed/runtime/dataloader.py'
2025-01-21T23:19:48,234   adding 'deepspeed/runtime/eigenvalue.py'
2025-01-21T23:19:48,252   adding 'deepspeed/runtime/engine.py'
2025-01-21T23:19:48,256   adding 'deepspeed/runtime/hybrid_engine.py'
2025-01-21T23:19:48,260   adding 'deepspeed/runtime/lr_schedules.py'
2025-01-21T23:19:48,261   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-01-21T23:19:48,263   adding 'deepspeed/runtime/quantize.py'
2025-01-21T23:19:48,264   adding 'deepspeed/runtime/sparse_tensor.py'
2025-01-21T23:19:48,266   adding 'deepspeed/runtime/state_dict_factory.py'
2025-01-21T23:19:48,271   adding 'deepspeed/runtime/utils.py'
2025-01-21T23:19:48,273   adding 'deepspeed/runtime/weight_quantizer.py'
2025-01-21T23:19:48,275   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-01-21T23:19:48,279   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-01-21T23:19:48,281   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-01-21T23:19:48,283   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-01-21T23:19:48,284   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-01-21T23:19:48,286   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-01-21T23:19:48,287   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-01-21T23:19:48,289   adding 'deepspeed/runtime/comm/__init__.py'
2025-01-21T23:19:48,290   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-01-21T23:19:48,292   adding 'deepspeed/runtime/comm/compressed.py'
2025-01-21T23:19:48,293   adding 'deepspeed/runtime/comm/hccl.py'
2025-01-21T23:19:48,295   adding 'deepspeed/runtime/comm/mpi.py'
2025-01-21T23:19:48,297   adding 'deepspeed/runtime/comm/nccl.py'
2025-01-21T23:19:48,298   adding 'deepspeed/runtime/compression/__init__.py'
2025-01-21T23:19:48,299   adding 'deepspeed/runtime/compression/cupy.py'
2025-01-21T23:19:48,301   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-01-21T23:19:48,302   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-01-21T23:19:48,304   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-01-21T23:19:48,306   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-01-21T23:19:48,307   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-01-21T23:19:48,309   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-01-21T23:19:48,310   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-01-21T23:19:48,311   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-01-21T23:19:48,313   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-01-21T23:19:48,314   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-01-21T23:19:48,319   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-01-21T23:19:48,322   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-01-21T23:19:48,325   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-01-21T23:19:48,326   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-01-21T23:19:48,327   adding 'deepspeed/runtime/domino/__init__.py'
2025-01-21T23:19:48,329   adding 'deepspeed/runtime/domino/transformer.py'
2025-01-21T23:19:48,331   adding 'deepspeed/runtime/fp16/__init__.py'
2025-01-21T23:19:48,334   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-01-21T23:19:48,336   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-01-21T23:19:48,338   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-01-21T23:19:48,339   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-01-21T23:19:48,342   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-01-21T23:19:48,344   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-01-21T23:19:48,347   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-01-21T23:19:48,348   adding 'deepspeed/runtime/pipe/__init__.py'
2025-01-21T23:19:48,355   adding 'deepspeed/runtime/pipe/engine.py'
2025-01-21T23:19:48,359   adding 'deepspeed/runtime/pipe/module.py'
2025-01-21T23:19:48,361   adding 'deepspeed/runtime/pipe/p2p.py'
2025-01-21T23:19:48,363   adding 'deepspeed/runtime/pipe/schedule.py'
2025-01-21T23:19:48,365   adding 'deepspeed/runtime/pipe/topology.py'
2025-01-21T23:19:48,367   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-01-21T23:19:48,368   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-01-21T23:19:48,369   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-01-21T23:19:48,371   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-01-21T23:19:48,373   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-01-21T23:19:48,375   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-01-21T23:19:48,377   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-01-21T23:19:48,379   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-01-21T23:19:48,381   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-01-21T23:19:48,382   adding 'deepspeed/runtime/zero/__init__.py'
2025-01-21T23:19:48,385   adding 'deepspeed/runtime/zero/config.py'
2025-01-21T23:19:48,387   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-01-21T23:19:48,388   adding 'deepspeed/runtime/zero/linear.py'
2025-01-21T23:19:48,391   adding 'deepspeed/runtime/zero/mics.py'
2025-01-21T23:19:48,393   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-01-21T23:19:48,394   adding 'deepspeed/runtime/zero/offload_config.py'
2025-01-21T23:19:48,395   adding 'deepspeed/runtime/zero/offload_states.py'
2025-01-21T23:19:48,398   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-01-21T23:19:48,410   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-01-21T23:19:48,414   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-01-21T23:19:48,415   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-01-21T23:19:48,431   adding 'deepspeed/runtime/zero/stage3.py'
2025-01-21T23:19:48,445   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-01-21T23:19:48,447   adding 'deepspeed/runtime/zero/test.py'
2025-01-21T23:19:48,449   adding 'deepspeed/runtime/zero/tiling.py'
2025-01-21T23:19:48,451   adding 'deepspeed/runtime/zero/utils.py'
2025-01-21T23:19:48,452   adding 'deepspeed/sequence/__init__.py'
2025-01-21T23:19:48,454   adding 'deepspeed/sequence/cross_entropy.py'
2025-01-21T23:19:48,458   adding 'deepspeed/sequence/fpdt_layer.py'
2025-01-21T23:19:48,461   adding 'deepspeed/sequence/layer.py'
2025-01-21T23:19:48,463   adding 'deepspeed/utils/__init__.py'
2025-01-21T23:19:48,464   adding 'deepspeed/utils/bwc.py'
2025-01-21T23:19:48,466   adding 'deepspeed/utils/comms_logging.py'
2025-01-21T23:19:48,467   adding 'deepspeed/utils/config.py'
2025-01-21T23:19:48,468   adding 'deepspeed/utils/debug.py'
2025-01-21T23:19:48,470   adding 'deepspeed/utils/exceptions.py'
2025-01-21T23:19:48,472   adding 'deepspeed/utils/groups.py'
2025-01-21T23:19:48,474   adding 'deepspeed/utils/init_on_device.py'
2025-01-21T23:19:48,475   adding 'deepspeed/utils/logging.py'
2025-01-21T23:19:48,476   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-01-21T23:19:48,478   adding 'deepspeed/utils/numa.py'
2025-01-21T23:19:48,479   adding 'deepspeed/utils/nvtx.py'
2025-01-21T23:19:48,481   adding 'deepspeed/utils/tensor_fragment.py'
2025-01-21T23:19:48,482   adding 'deepspeed/utils/timer.py'
2025-01-21T23:19:48,483   adding 'deepspeed/utils/torch.py'
2025-01-21T23:19:48,485   adding 'deepspeed/utils/types.py'
2025-01-21T23:19:48,486   adding 'deepspeed/utils/z3_leaf_module.py'
2025-01-21T23:19:48,489   adding 'deepspeed/utils/zero_to_fp32.py'
2025-01-21T23:19:48,491   adding 'deepspeed-0.16.3.data/scripts/deepspeed'
2025-01-21T23:19:48,493   adding 'deepspeed-0.16.3.data/scripts/deepspeed.pt'
2025-01-21T23:19:48,494   adding 'deepspeed-0.16.3.data/scripts/ds'
2025-01-21T23:19:48,495   adding 'deepspeed-0.16.3.data/scripts/ds_bench'
2025-01-21T23:19:48,496   adding 'deepspeed-0.16.3.data/scripts/ds_elastic'
2025-01-21T23:19:48,497   adding 'deepspeed-0.16.3.data/scripts/ds_io'
2025-01-21T23:19:48,498   adding 'deepspeed-0.16.3.data/scripts/ds_nvme_tune'
2025-01-21T23:19:48,499   adding 'deepspeed-0.16.3.data/scripts/ds_report'
2025-01-21T23:19:48,501   adding 'deepspeed-0.16.3.data/scripts/ds_ssh'
2025-01-21T23:19:48,501   adding 'deepspeed-0.16.3.data/scripts/dsr'
2025-01-21T23:19:48,504   adding 'deepspeed-0.16.3.dist-info/LICENSE'
2025-01-21T23:19:48,509   adding 'deepspeed-0.16.3.dist-info/METADATA'
2025-01-21T23:19:48,511   adding 'deepspeed-0.16.3.dist-info/WHEEL'
2025-01-21T23:19:48,511   adding 'deepspeed-0.16.3.dist-info/entry_points.txt'
2025-01-21T23:19:48,512   adding 'deepspeed-0.16.3.dist-info/top_level.txt'
2025-01-21T23:19:48,527   adding 'deepspeed-0.16.3.dist-info/RECORD'
2025-01-21T23:19:48,554   removing build/bdist.linux-armv7l/wheel
2025-01-21T23:19:48,781   deepspeed build time = 11.644806861877441 secs
2025-01-21T23:19:48,906   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-01-21T23:19:48,924   Created wheel for deepspeed: filename=deepspeed-0.16.3-py3-none-any.whl size=1549937 sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a
2025-01-21T23:19:48,925   Stored in directory: /tmp/pip-ephem-wheel-cache-brhv7glp/wheels/ab/dc/d4/7e7e07b11bc7c0e2a1a495b967acf58de61261eed4596fb23b
2025-01-21T23:19:48,969 Successfully built deepspeed
2025-01-21T23:19:49,010 Removed build tracker: '/tmp/pip-build-tracker-flq6028s'