2025-02-20T16:03:15,591 Created temporary directory: /tmp/pip-build-tracker-hii_pn0q
2025-02-20T16:03:15,592 Initialized build tracking at /tmp/pip-build-tracker-hii_pn0q
2025-02-20T16:03:15,593 Created build tracker: /tmp/pip-build-tracker-hii_pn0q
2025-02-20T16:03:15,593 Entered build tracker: /tmp/pip-build-tracker-hii_pn0q
2025-02-20T16:03:15,594 Created temporary directory: /tmp/pip-wheel-7gqfvk1t
2025-02-20T16:03:15,598 Created temporary directory: /tmp/pip-ephem-wheel-cache-21mjkuam
2025-02-20T16:03:15,642 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-02-20T16:03:15,645 2 location(s) to search for versions of deepspeed:
2025-02-20T16:03:15,645 * https://pypi.org/simple/deepspeed/
2025-02-20T16:03:15,645 * https://www.piwheels.org/simple/deepspeed/
2025-02-20T16:03:15,645 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-02-20T16:03:15,646 Getting page https://pypi.org/simple/deepspeed/
2025-02-20T16:03:15,648 Found index url https://pypi.org/simple/
2025-02-20T16:03:15,797 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-02-20T16:03:15,818   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,818   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-02-20T16:03:15,819   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,820   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-02-20T16:03:15,820   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,821   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-02-20T16:03:15,822   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,823   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-02-20T16:03:15,823   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,824   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-02-20T16:03:15,825   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-02-20T16:03:15,825   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-02-20T16:03:15,826   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-02-20T16:03:15,827   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-02-20T16:03:15,828   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-02-20T16:03:15,828   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-02-20T16:03:15,829   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-02-20T16:03:15,830   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-02-20T16:03:15,830   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-02-20T16:03:15,831   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-02-20T16:03:15,832   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-02-20T16:03:15,832   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-02-20T16:03:15,833   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-02-20T16:03:15,834   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-02-20T16:03:15,835   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-02-20T16:03:15,835   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-02-20T16:03:15,836   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-02-20T16:03:15,837   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-02-20T16:03:15,838   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-02-20T16:03:15,838   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-02-20T16:03:15,839   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-02-20T16:03:15,840   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-02-20T16:03:15,841   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-02-20T16:03:15,841   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-02-20T16:03:15,842   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-02-20T16:03:15,842   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-02-20T16:03:15,843   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-02-20T16:03:15,844   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-02-20T16:03:15,844   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-02-20T16:03:15,845   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-02-20T16:03:15,846   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-02-20T16:03:15,847   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-02-20T16:03:15,848   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-02-20T16:03:15,848   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-02-20T16:03:15,849   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-02-20T16:03:15,850   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-02-20T16:03:15,851   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-02-20T16:03:15,851   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-02-20T16:03:15,852   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-02-20T16:03:15,853   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-02-20T16:03:15,854   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-02-20T16:03:15,854   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-02-20T16:03:15,855   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-02-20T16:03:15,856   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-02-20T16:03:15,856   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-02-20T16:03:15,857   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-02-20T16:03:15,857   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-02-20T16:03:15,858   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-02-20T16:03:15,859   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-02-20T16:03:15,860   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-02-20T16:03:15,860   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-02-20T16:03:15,861   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-02-20T16:03:15,862   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-02-20T16:03:15,862   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-02-20T16:03:15,863   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-02-20T16:03:15,864   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-02-20T16:03:15,865   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-02-20T16:03:15,865   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-02-20T16:03:15,866   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-02-20T16:03:15,867   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-02-20T16:03:15,868   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-02-20T16:03:15,868   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-02-20T16:03:15,869   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-02-20T16:03:15,869   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-02-20T16:03:15,870   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-02-20T16:03:15,871   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-02-20T16:03:15,871   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-02-20T16:03:15,872   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-02-20T16:03:15,873   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-02-20T16:03:15,874   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-02-20T16:03:15,874   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-02-20T16:03:15,875   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-02-20T16:03:15,876   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-02-20T16:03:15,876   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-02-20T16:03:15,877   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-02-20T16:03:15,878   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-02-20T16:03:15,879   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-02-20T16:03:15,879   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-02-20T16:03:15,880   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-02-20T16:03:15,880   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-02-20T16:03:15,881   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-02-20T16:03:15,882   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-02-20T16:03:15,882   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-02-20T16:03:15,883   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-02-20T16:03:15,883   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-02-20T16:03:15,884   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-02-20T16:03:15,885   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,886   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-02-20T16:03:15,887   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,887   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-02-20T16:03:15,888   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-02-20T16:03:15,889   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-02-20T16:03:15,889   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-02-20T16:03:15,890   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-02-20T16:03:15,891   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-02-20T16:03:15,892   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-02-20T16:03:15,892   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-02-20T16:03:15,893   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,893   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,894   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-02-20T16:03:15,894   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-02-20T16:03:15,895   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2025-02-20T16:03:15,895 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-02-20T16:03:15,896 Getting page https://www.piwheels.org/simple/deepspeed/
2025-02-20T16:03:15,898 Found index url https://www.piwheels.org/simple/
2025-02-20T16:03:16,064 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2025-02-20T16:03:16,084   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.3-py3-none-any.whl#sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,085   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,086   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,087   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,087   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,088   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,089   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,089   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,090   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,090   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,091   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,091   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,092   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,092   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,093   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,094   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,094   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,095   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,096   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,096   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,097   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,098   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,099   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,099   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,100   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,100   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,101   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,102   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,102   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,103   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,104   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,105   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,105   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,106   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,106   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,107   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,108   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,109   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,109   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,110   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,110   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,111   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,111   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,112   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,112   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,113   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,114   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,114   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,115   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,116   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,116   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,117   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,118   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,118   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,119   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,119   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,120   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,120   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,121   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,121   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,122   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,123   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,123   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,124   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,124   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,125   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,126   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,126   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,127   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,127   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,128   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,128   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,129   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,129   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,130   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,131   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2025-02-20T16:03:16,131 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-02-20T16:03:16,132 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-02-20T16:03:16,164 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-02-20T16:03:16,167 Collecting deepspeed==0.16.4
2025-02-20T16:03:16,169   Created temporary directory: /tmp/pip-unpack-pgesyjwo
2025-02-20T16:03:16,402   Downloading deepspeed-0.16.4.tar.gz (1.4 MB)
2025-02-20T16:03:18,902   Added deepspeed==0.16.4 from https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz to build tracker '/tmp/pip-build-tracker-hii_pn0q'
2025-02-20T16:03:18,904   Running setup.py (path:/tmp/pip-wheel-7gqfvk1t/deepspeed_37689e7fb30f434aab3571034fbd6180/setup.py) egg_info for package deepspeed
2025-02-20T16:03:18,904   Created temporary directory: /tmp/pip-pip-egg-info-ebkvtigk
2025-02-20T16:03:18,905   Preparing metadata (setup.py): started
2025-02-20T16:03:18,907   Running command python setup.py egg_info
2025-02-20T16:03:20,146   fatal: not a git repository (or any of the parent directories): .git
2025-02-20T16:03:20,806   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-02-20T16:03:20,807    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-02-20T16:03:20,807   DS_BUILD_OPS=0
2025-02-20T16:03:20,808   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-02-20T16:03:20,808   version=0.16.4, git_hash=unknown, git_branch=unknown
2025-02-20T16:03:20,809   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-02-20T16:03:20,809   ext_modules=[]
2025-02-20T16:03:20,810   running egg_info
2025-02-20T16:03:20,834   creating /tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info
2025-02-20T16:03:20,835   writing /tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info/PKG-INFO
2025-02-20T16:03:20,869   writing dependency_links to /tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info/dependency_links.txt
2025-02-20T16:03:20,870   writing entry points to /tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info/entry_points.txt
2025-02-20T16:03:20,888   writing requirements to /tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info/requires.txt
2025-02-20T16:03:20,889   writing top-level names to /tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info/top_level.txt
2025-02-20T16:03:20,890   writing manifest file '/tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info/SOURCES.txt'
2025-02-20T16:03:21,135   reading manifest file '/tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info/SOURCES.txt'
2025-02-20T16:03:21,137   reading manifest template 'MANIFEST.in'
2025-02-20T16:03:21,139   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-02-20T16:03:21,139   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-02-20T16:03:23,015   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-02-20T16:03:24,266   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-02-20T16:03:25,016   warning: no files found matching '*.tr' under directory 'csrc'
2025-02-20T16:03:25,138   warning: no files found matching '*.cc' under directory 'csrc'
2025-02-20T16:03:25,185   warning: no files found matching '*.py' under directory 'benchmarks'
2025-02-20T16:03:25,191   adding license file 'LICENSE'
2025-02-20T16:03:25,230   writing manifest file '/tmp/pip-pip-egg-info-ebkvtigk/deepspeed.egg-info/SOURCES.txt'
2025-02-20T16:03:25,233   deepspeed build time = 5.084386825561523 secs
2025-02-20T16:03:25,352   Preparing metadata (setup.py): finished with status 'done'
2025-02-20T16:03:25,358   Source in /tmp/pip-wheel-7gqfvk1t/deepspeed_37689e7fb30f434aab3571034fbd6180 has version 0.16.4, which satisfies requirement deepspeed==0.16.4 from https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz
2025-02-20T16:03:25,359   Removed deepspeed==0.16.4 from https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz from build tracker '/tmp/pip-build-tracker-hii_pn0q'
2025-02-20T16:03:25,431 Created temporary directory: /tmp/pip-unpack-n7w3a99d
2025-02-20T16:03:25,432 Created temporary directory: /tmp/pip-unpack-x1hu6jwr
2025-02-20T16:03:25,433 Building wheels for collected packages: deepspeed
2025-02-20T16:03:25,437   Created temporary directory: /tmp/pip-wheel-it42njwn
2025-02-20T16:03:25,438   Building wheel for deepspeed (setup.py): started
2025-02-20T16:03:25,439   Destination directory: /tmp/pip-wheel-it42njwn
2025-02-20T16:03:25,440   Running command python setup.py bdist_wheel
2025-02-20T16:03:26,167   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-02-20T16:03:26,172    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-02-20T16:03:26,296   DS_BUILD_OPS=0
2025-02-20T16:03:26,411   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-02-20T16:03:26,430   fatal: not a git repository (or any of the parent directories): .git
2025-02-20T16:03:26,432   version=0.16.4, git_hash=unknown, git_branch=unknown
2025-02-20T16:03:26,432   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-02-20T16:03:26,433   ext_modules=[]
2025-02-20T16:03:27,064   running bdist_wheel
2025-02-20T16:03:27,216   running build
2025-02-20T16:03:27,217   running build_py
2025-02-20T16:03:27,247   creating build/lib/deepspeed
2025-02-20T16:03:27,249   copying deepspeed/constants.py -> build/lib/deepspeed
2025-02-20T16:03:27,251   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-02-20T16:03:27,253   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-02-20T16:03:27,255   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-02-20T16:03:27,258   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-02-20T16:03:27,260   creating build/lib/deepspeed/sequence
2025-02-20T16:03:27,261   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-02-20T16:03:27,264   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-02-20T16:03:27,267   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-02-20T16:03:27,269   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-02-20T16:03:27,272   creating build/lib/deepspeed/model_implementations
2025-02-20T16:03:27,273   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-02-20T16:03:27,276   creating build/lib/deepspeed/moe
2025-02-20T16:03:27,277   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-02-20T16:03:27,279   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-02-20T16:03:27,282   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-02-20T16:03:27,284   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-02-20T16:03:27,286   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-02-20T16:03:27,288   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-02-20T16:03:27,291   creating build/lib/deepspeed/profiling
2025-02-20T16:03:27,292   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-02-20T16:03:27,294   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-02-20T16:03:27,296   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-02-20T16:03:27,299   creating build/lib/deepspeed/nvme
2025-02-20T16:03:27,300   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,302   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,304   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,306   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,309   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,311   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,314   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,316   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,318   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,320   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,323   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,325   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-02-20T16:03:27,327   creating build/lib/deepspeed/utils
2025-02-20T16:03:27,328   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,331   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,332   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,334   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,336   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,338   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,340   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,342   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,346   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,349   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,351   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,352   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,355   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,357   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,359   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,362   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,365   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,367   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-02-20T16:03:27,370   creating build/lib/deepspeed/linear
2025-02-20T16:03:27,371   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-02-20T16:03:27,374   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-02-20T16:03:27,376   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-02-20T16:03:27,378   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-02-20T16:03:27,380   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-02-20T16:03:27,383   creating build/lib/deepspeed/autotuning
2025-02-20T16:03:27,384   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-02-20T16:03:27,388   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-02-20T16:03:27,391   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-02-20T16:03:27,393   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-02-20T16:03:27,395   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-02-20T16:03:27,398   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-02-20T16:03:27,402   creating build/lib/deepspeed/accelerator
2025-02-20T16:03:27,403   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,406   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,408   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,411   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,413   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,416   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,418   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,420   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,423   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,426   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-02-20T16:03:27,429   creating build/lib/deepspeed/monitor
2025-02-20T16:03:27,430   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-02-20T16:03:27,432   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-02-20T16:03:27,435   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-02-20T16:03:27,437   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-02-20T16:03:27,439   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-02-20T16:03:27,441   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-02-20T16:03:27,443   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-02-20T16:03:27,446   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-02-20T16:03:27,448   creating build/lib/deepspeed/ops
2025-02-20T16:03:27,449   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-02-20T16:03:27,452   creating build/lib/deepspeed/runtime
2025-02-20T16:03:27,453   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,456   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,458   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,461   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,464   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,466   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,468   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,471   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,476   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,479   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,482   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,484   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,488   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,490   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,492   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,495   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,498   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,500   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-02-20T16:03:27,502   creating build/lib/deepspeed/compression
2025-02-20T16:03:27,503   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-02-20T16:03:27,506   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-02-20T16:03:27,508   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-02-20T16:03:27,511   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-02-20T16:03:27,513   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-02-20T16:03:27,516   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-02-20T16:03:27,518   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-02-20T16:03:27,521   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-02-20T16:03:27,524   creating build/lib/deepspeed/inference
2025-02-20T16:03:27,525   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-02-20T16:03:27,528   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-02-20T16:03:27,531   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-02-20T16:03:27,533   creating build/lib/deepspeed/pipe
2025-02-20T16:03:27,534   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-02-20T16:03:27,536   creating build/lib/deepspeed/elasticity
2025-02-20T16:03:27,537   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-02-20T16:03:27,539   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-02-20T16:03:27,541   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-02-20T16:03:27,543   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-02-20T16:03:27,545   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-02-20T16:03:27,547   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-02-20T16:03:27,550   creating build/lib/deepspeed/comm
2025-02-20T16:03:27,551   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,553   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,555   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,557   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,559   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,560   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,562   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,564   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,566   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-02-20T16:03:27,570   creating build/lib/deepspeed/launcher
2025-02-20T16:03:27,571   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-02-20T16:03:27,573   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-02-20T16:03:27,575   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-02-20T16:03:27,577   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-02-20T16:03:27,579   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-02-20T16:03:27,582   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-02-20T16:03:27,585   creating build/lib/deepspeed/module_inject
2025-02-20T16:03:27,586   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,590   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,591   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,594   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,596   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,598   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,602   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,604   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,606   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,608   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,611   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,614   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,616   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-02-20T16:03:27,619   creating build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,620   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,622   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,623   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,626   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,628   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,631   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,634   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,636   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,639   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,641   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-02-20T16:03:27,644   creating build/lib/deepspeed/nebula
2025-02-20T16:03:27,645   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-02-20T16:03:27,647   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-02-20T16:03:27,649   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-02-20T16:03:27,652   creating build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,653   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,655   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,658   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,660   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,662   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,664   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,666   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,668   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,670   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,672   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-02-20T16:03:27,675   creating build/lib/deepspeed/model_implementations/features
2025-02-20T16:03:27,676   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-02-20T16:03:27,678   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-02-20T16:03:27,681   creating build/lib/deepspeed/model_implementations/diffusers
2025-02-20T16:03:27,682   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-02-20T16:03:27,684   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-02-20T16:03:27,686   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-02-20T16:03:27,689   creating build/lib/deepspeed/profiling/flops_profiler
2025-02-20T16:03:27,690   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-02-20T16:03:27,692   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-02-20T16:03:27,697   creating build/lib/deepspeed/autotuning/tuner
2025-02-20T16:03:27,698   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-02-20T16:03:27,700   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-02-20T16:03:27,702   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-02-20T16:03:27,704   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-02-20T16:03:27,706   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-02-20T16:03:27,708   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-02-20T16:03:27,711   creating build/lib/deepspeed/ops/gds
2025-02-20T16:03:27,712   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-02-20T16:03:27,714   creating build/lib/deepspeed/ops/adagrad
2025-02-20T16:03:27,716   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-02-20T16:03:27,718   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-02-20T16:03:27,721   creating build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,722   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,724   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,726   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,728   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,730   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,732   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,734   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,736   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,738   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,740   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,742   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,744   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,747   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,749   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,752   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,754   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,756   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,759   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,762   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,764   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,766   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,768   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,770   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,773   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-02-20T16:03:27,775   creating build/lib/deepspeed/ops/lion
2025-02-20T16:03:27,777   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-02-20T16:03:27,780   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-02-20T16:03:27,782   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-02-20T16:03:27,784   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-02-20T16:03:27,787   creating build/lib/deepspeed/ops/lamb
2025-02-20T16:03:27,788   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-02-20T16:03:27,790   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-02-20T16:03:27,792   creating build/lib/deepspeed/ops/aio
2025-02-20T16:03:27,794   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-02-20T16:03:27,796   creating build/lib/deepspeed/ops/random_ltd
2025-02-20T16:03:27,797   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-02-20T16:03:27,800   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-02-20T16:03:27,802   creating build/lib/deepspeed/ops/fp_quantizer
2025-02-20T16:03:27,803   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-02-20T16:03:27,806   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-02-20T16:03:27,808   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-02-20T16:03:27,810   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-02-20T16:03:27,813   creating build/lib/deepspeed/ops/quantizer
2025-02-20T16:03:27,814   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-02-20T16:03:27,816   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-02-20T16:03:27,819   creating build/lib/deepspeed/ops/transformer
2025-02-20T16:03:27,820   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-02-20T16:03:27,822   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-02-20T16:03:27,825   creating build/lib/deepspeed/ops/deepspeed4science
2025-02-20T16:03:27,826   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-02-20T16:03:27,828   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-02-20T16:03:27,831   creating build/lib/deepspeed/ops/adam
2025-02-20T16:03:27,832   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-02-20T16:03:27,835   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-02-20T16:03:27,838   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-02-20T16:03:27,839   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-02-20T16:03:27,842   creating build/lib/deepspeed/ops/sparse_attention
2025-02-20T16:03:27,843   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-02-20T16:03:27,847   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-02-20T16:03:27,850   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-02-20T16:03:27,852   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-02-20T16:03:27,855   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-02-20T16:03:27,858   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-02-20T16:03:27,860   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-02-20T16:03:27,864   creating build/lib/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:27,866   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:27,869   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:27,871   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:27,873   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:27,875   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:27,878   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:27,880   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:27,883   creating build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,885   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,887   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,889   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,891   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,893   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,896   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,898   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,900   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,903   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,905   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:27,908   creating build/lib/deepspeed/ops/op_builder/mlu
2025-02-20T16:03:27,910   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-02-20T16:03:27,913   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-02-20T16:03:27,915   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-02-20T16:03:27,917   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-02-20T16:03:27,919   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-02-20T16:03:27,922   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-02-20T16:03:27,924   creating build/lib/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:27,926   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:27,928   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:27,931   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:27,935   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:27,942   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:27,945   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:27,948   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:27,951   creating build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,952   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,955   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,958   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,960   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,962   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,965   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,967   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,970   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,972   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-02-20T16:03:27,975   creating build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:27,977   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:27,980   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:27,983   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:27,985   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:27,988   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:27,990   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:27,993   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:27,997   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:28,001   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:28,004   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-02-20T16:03:28,009   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,011   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,014   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,017   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,020   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,023   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,026   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,029   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,032   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,036   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,038   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:28,043   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,045   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,048   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,050   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,053   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,056   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,058   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,062   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,065   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,068   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,077   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,087   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,095   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,097   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,099   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,103   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,105   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,108   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,110   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,113   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,115   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,118   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,121   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,123   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:28,127   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:28,128   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:28,131   creating build/lib/deepspeed/runtime/domino
2025-02-20T16:03:28,133   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-02-20T16:03:28,135   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-02-20T16:03:28,139   creating build/lib/deepspeed/runtime/tensor_parallel
2025-02-20T16:03:28,141   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-02-20T16:03:28,144   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-02-20T16:03:28,146   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-02-20T16:03:28,149   creating build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,151   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,153   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,156   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,158   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,160   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,164   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,167   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,169   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,172   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-02-20T16:03:28,176   creating build/lib/deepspeed/runtime/fp16
2025-02-20T16:03:28,178   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-02-20T16:03:28,181   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-02-20T16:03:28,184   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-02-20T16:03:28,187   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-02-20T16:03:28,191   creating build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,192   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,195   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,197   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,199   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,204   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,206   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,215   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,217   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,219   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,222   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,224   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,227   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,230   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,232   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,236   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,238   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,240   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-02-20T16:03:28,243   creating build/lib/deepspeed/runtime/compression
2025-02-20T16:03:28,244   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-02-20T16:03:28,246   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-02-20T16:03:28,249   creating build/lib/deepspeed/runtime/pipe
2025-02-20T16:03:28,251   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-02-20T16:03:28,254   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-02-20T16:03:28,256   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-02-20T16:03:28,259   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-02-20T16:03:28,262   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-02-20T16:03:28,264   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-02-20T16:03:28,268   creating build/lib/deepspeed/runtime/comm
2025-02-20T16:03:28,269   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-02-20T16:03:28,271   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-02-20T16:03:28,274   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-02-20T16:03:28,277   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-02-20T16:03:28,279   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-02-20T16:03:28,282   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-02-20T16:03:28,284   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:28,286   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:28,288   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:28,290   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:28,292   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:28,295   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-02-20T16:03:28,296   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-02-20T16:03:28,298   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-02-20T16:03:28,300   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-02-20T16:03:28,304   creating build/lib/deepspeed/runtime/data_pipeline
2025-02-20T16:03:28,306   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-02-20T16:03:28,308   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-02-20T16:03:28,311   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-02-20T16:03:28,313   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-02-20T16:03:28,317   creating build/lib/deepspeed/runtime/fp16/onebit
2025-02-20T16:03:28,318   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-02-20T16:03:28,321   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-02-20T16:03:28,323   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-02-20T16:03:28,326   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-02-20T16:03:28,330   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:28,331   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:28,335   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:28,337   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:28,340   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:28,342   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:28,345   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:28,347   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:28,348   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:28,350   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:28,353   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:28,355   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:28,358   creating build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,359   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,361   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,364   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,366   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,369   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,371   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,374   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,376   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,379   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-02-20T16:03:28,382   creating build/lib/deepspeed/inference/quantization
2025-02-20T16:03:28,383   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-02-20T16:03:28,386   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-02-20T16:03:28,389   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-02-20T16:03:28,391   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-02-20T16:03:28,394   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-02-20T16:03:28,397   creating build/lib/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:28,399   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:28,402   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:28,405   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:28,407   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:28,410   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:28,413   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:28,416   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:28,420   creating build/lib/deepspeed/inference/v2/ragged
2025-02-20T16:03:28,422   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-02-20T16:03:28,425   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-02-20T16:03:28,428   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-02-20T16:03:28,430   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-02-20T16:03:28,433   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-02-20T16:03:28,436   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-02-20T16:03:28,439   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-02-20T16:03:28,442   creating build/lib/deepspeed/inference/v2/kernels
2025-02-20T16:03:28,444   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-02-20T16:03:28,446   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-02-20T16:03:28,449   creating build/lib/deepspeed/inference/v2/modules
2025-02-20T16:03:28,451   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-02-20T16:03:28,454   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-02-20T16:03:28,456   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-02-20T16:03:28,459   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-02-20T16:03:28,461   creating build/lib/deepspeed/inference/v2/checkpoint
2025-02-20T16:03:28,463   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-02-20T16:03:28,466   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-02-20T16:03:28,468   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-02-20T16:03:28,471   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-02-20T16:03:28,475   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:28,477   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:28,479   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:28,481   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:28,484   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:28,487   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:28,489   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:28,492   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:28,495   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:28,497   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:28,500   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:28,502   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:28,504   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:28,507   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:28,510   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:28,513   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:28,515   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:28,518   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:28,520   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:28,522   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:28,525   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,527   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,529   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,532   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,534   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,536   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,539   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,541   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,544   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,547   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:28,550   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:28,551   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:28,554   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:28,556   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:28,560   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:28,564   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:28,565   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:28,567   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:28,569   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:28,571   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:28,574   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:28,576   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:28,578   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:28,580   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:28,582   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:28,585   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:28,587   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:28,589   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:28,591   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:28,594   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:28,596   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:28,598   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:28,601   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:28,603   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:28,606   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:28,608   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,610   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,612   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,614   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,617   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,619   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,622   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,624   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,626   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,628   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:28,631   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:28,632   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:28,634   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:28,636   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:28,639   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:28,642   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-02-20T16:03:28,643   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-02-20T16:03:28,646   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-02-20T16:03:28,647   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-02-20T16:03:28,649   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-02-20T16:03:28,650   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-02-20T16:03:28,653   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:28,654   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:28,657   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:28,660   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:28,661   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:28,663   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:28,666   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:28,667   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:28,669   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:28,672   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:28,674   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:28,676   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:28,678   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:28,680   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:28,682   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:28,684   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:28,686   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:28,688   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:28,690   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:28,691   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:28,694   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:28,695   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:28,698   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:28,700   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:28,702   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:28,704   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:28,707   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:28,708   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:28,711   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:28,713   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:28,716   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:28,717   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:28,719   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:28,722   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:28,723   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:28,725   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:28,728   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:28,729   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:28,731   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:28,734   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:28,735   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:28,737   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:28,740   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:28,742   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:28,744   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:28,747   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:28,748   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:28,750   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:28,752   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:28,754   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:28,756   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:28,758   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:28,759   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:28,761   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:28,763   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:28,766   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:28,768   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-02-20T16:03:28,769   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-02-20T16:03:28,772   creating build/lib/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:28,773   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:28,775   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:28,777   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:28,779   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:28,782   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:28,783   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:28,786   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:28,788   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,789   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,792   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,794   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,796   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,798   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,800   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,802   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,804   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:28,807   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-02-20T16:03:28,808   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-02-20T16:03:28,811   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-02-20T16:03:28,813   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-02-20T16:03:28,814   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-02-20T16:03:28,816   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-02-20T16:03:28,819   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-02-20T16:03:28,821   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-02-20T16:03:28,822   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-02-20T16:03:28,824   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-02-20T16:03:28,826   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-02-20T16:03:28,829   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-02-20T16:03:28,830   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-02-20T16:03:28,833   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-02-20T16:03:28,836   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-02-20T16:03:28,837   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-02-20T16:03:28,839   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-02-20T16:03:28,842   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-02-20T16:03:28,843   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-02-20T16:03:28,845   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-02-20T16:03:28,848   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-02-20T16:03:28,849   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-02-20T16:03:28,851   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-02-20T16:03:28,855   creating build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,856   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,858   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,860   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,862   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,865   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,866   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,869   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,871   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,873   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,875   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,877   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,879   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,881   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,883   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,886   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,889   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,891   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,893   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,895   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-02-20T16:03:28,898   creating build/lib/deepspeed/module_inject/containers/features
2025-02-20T16:03:28,900   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-02-20T16:03:28,903   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-02-20T16:03:28,906   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-02-20T16:03:28,908   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-02-20T16:03:28,911   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-02-20T16:03:28,915   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-02-20T16:03:28,917   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-02-20T16:03:28,922   running egg_info
2025-02-20T16:03:28,965   writing deepspeed.egg-info/PKG-INFO
2025-02-20T16:03:29,012   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-02-20T16:03:29,015   writing entry points to deepspeed.egg-info/entry_points.txt
2025-02-20T16:03:29,031   writing requirements to deepspeed.egg-info/requires.txt
2025-02-20T16:03:29,033   writing top-level names to deepspeed.egg-info/top_level.txt
2025-02-20T16:03:29,171   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-02-20T16:03:29,241   reading manifest template 'MANIFEST.in'
2025-02-20T16:03:29,242   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-02-20T16:03:29,243   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-02-20T16:03:30,846   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-02-20T16:03:31,799   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-02-20T16:03:32,428   warning: no files found matching '*.tr' under directory 'csrc'
2025-02-20T16:03:32,547   warning: no files found matching '*.cc' under directory 'csrc'
2025-02-20T16:03:32,592   warning: no files found matching '*.py' under directory 'benchmarks'
2025-02-20T16:03:32,598   adding license file 'LICENSE'
2025-02-20T16:03:32,649   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-02-20T16:03:32,658   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-02-20T16:03:32,659   !!

2025-02-20T16:03:32,659           ********************************************************************************
2025-02-20T16:03:32,660           ############################
2025-02-20T16:03:32,660           # Package would be ignored #
2025-02-20T16:03:32,661           ############################
2025-02-20T16:03:32,661           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-02-20T16:03:32,662           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,663           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,664           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-02-20T16:03:32,665           to the `packages` configuration field.

2025-02-20T16:03:32,666           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,666           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,667           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,668           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,669           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,671           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-02-20T16:03:32,671           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-02-20T16:03:32,672           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,672           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,673           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,674           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,675           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,676           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,677                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,677                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,678                 directory, all directories are treated like packages.
2025-02-20T16:03:32,678           ********************************************************************************

2025-02-20T16:03:32,679   !!
2025-02-20T16:03:32,680     check.warn(importable)
2025-02-20T16:03:32,681   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-02-20T16:03:32,681   !!

2025-02-20T16:03:32,682           ********************************************************************************
2025-02-20T16:03:32,683           ############################
2025-02-20T16:03:32,683           # Package would be ignored #
2025-02-20T16:03:32,684           ############################
2025-02-20T16:03:32,684           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-02-20T16:03:32,684           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,685           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,686           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-02-20T16:03:32,686           to the `packages` configuration field.

2025-02-20T16:03:32,687           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,687           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,687           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,688           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,689           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,690           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-02-20T16:03:32,690           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-02-20T16:03:32,691           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,691           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,692           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,693           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,694           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,696           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,696                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,697                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,698                 directory, all directories are treated like packages.
2025-02-20T16:03:32,698           ********************************************************************************

2025-02-20T16:03:32,699   !!
2025-02-20T16:03:32,699     check.warn(importable)
2025-02-20T16:03:32,700   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-02-20T16:03:32,700   !!

2025-02-20T16:03:32,701           ********************************************************************************
2025-02-20T16:03:32,702           ############################
2025-02-20T16:03:32,702           # Package would be ignored #
2025-02-20T16:03:32,703           ############################
2025-02-20T16:03:32,703           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-02-20T16:03:32,704           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,705           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,706           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-02-20T16:03:32,706           to the `packages` configuration field.

2025-02-20T16:03:32,707           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,707           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,708           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,708           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,709           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,710           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-02-20T16:03:32,710           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-02-20T16:03:32,711           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,711           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,711           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,712           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,713           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,714           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,714                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,715                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,715                 directory, all directories are treated like packages.
2025-02-20T16:03:32,716           ********************************************************************************

2025-02-20T16:03:32,717   !!
2025-02-20T16:03:32,717     check.warn(importable)
2025-02-20T16:03:32,718   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-02-20T16:03:32,718   !!

2025-02-20T16:03:32,719           ********************************************************************************
2025-02-20T16:03:32,720           ############################
2025-02-20T16:03:32,720           # Package would be ignored #
2025-02-20T16:03:32,721           ############################
2025-02-20T16:03:32,721           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-02-20T16:03:32,722           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,723           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,724           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-02-20T16:03:32,724           to the `packages` configuration field.

2025-02-20T16:03:32,725           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,726           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,726           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,727           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,728           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,729           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-02-20T16:03:32,729           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-02-20T16:03:32,730           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,731           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,731           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,732           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,733           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,734           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,735                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,735                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,735                 directory, all directories are treated like packages.
2025-02-20T16:03:32,736           ********************************************************************************

2025-02-20T16:03:32,736   !!
2025-02-20T16:03:32,737     check.warn(importable)
2025-02-20T16:03:32,737   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-02-20T16:03:32,738   !!

2025-02-20T16:03:32,738           ********************************************************************************
2025-02-20T16:03:32,739           ############################
2025-02-20T16:03:32,739           # Package would be ignored #
2025-02-20T16:03:32,739           ############################
2025-02-20T16:03:32,740           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-02-20T16:03:32,740           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,741           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,741           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-02-20T16:03:32,742           to the `packages` configuration field.

2025-02-20T16:03:32,743           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,744           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,744           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,745           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,747           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,748           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-02-20T16:03:32,748           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-02-20T16:03:32,749           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,750           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,750           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,751           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,752           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,754           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,754                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,755                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,755                 directory, all directories are treated like packages.
2025-02-20T16:03:32,756           ********************************************************************************

2025-02-20T16:03:32,757   !!
2025-02-20T16:03:32,757     check.warn(importable)
2025-02-20T16:03:32,758   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-02-20T16:03:32,759   !!

2025-02-20T16:03:32,760           ********************************************************************************
2025-02-20T16:03:32,760           ############################
2025-02-20T16:03:32,760           # Package would be ignored #
2025-02-20T16:03:32,761           ############################
2025-02-20T16:03:32,761           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-02-20T16:03:32,762           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,762           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,763           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-02-20T16:03:32,763           to the `packages` configuration field.

2025-02-20T16:03:32,764           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,764           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,764           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,765           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,766           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,767           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-02-20T16:03:32,767           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-02-20T16:03:32,767           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,768           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,768           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,769           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,770           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,772           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,772                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,773                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,774                 directory, all directories are treated like packages.
2025-02-20T16:03:32,774           ********************************************************************************

2025-02-20T16:03:32,775   !!
2025-02-20T16:03:32,776     check.warn(importable)
2025-02-20T16:03:32,776   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-02-20T16:03:32,777   !!

2025-02-20T16:03:32,778           ********************************************************************************
2025-02-20T16:03:32,778           ############################
2025-02-20T16:03:32,779           # Package would be ignored #
2025-02-20T16:03:32,779           ############################
2025-02-20T16:03:32,780           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-02-20T16:03:32,780           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,782           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,782           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-02-20T16:03:32,782           to the `packages` configuration field.

2025-02-20T16:03:32,784           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,784           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,785           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,786           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,787           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,788           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-02-20T16:03:32,788           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-02-20T16:03:32,788           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,789           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,789           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,790           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,790           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,791           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,792                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,792                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,792                 directory, all directories are treated like packages.
2025-02-20T16:03:32,793           ********************************************************************************

2025-02-20T16:03:32,794   !!
2025-02-20T16:03:32,794     check.warn(importable)
2025-02-20T16:03:32,794   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-02-20T16:03:32,795   !!

2025-02-20T16:03:32,796           ********************************************************************************
2025-02-20T16:03:32,796           ############################
2025-02-20T16:03:32,798           # Package would be ignored #
2025-02-20T16:03:32,798           ############################
2025-02-20T16:03:32,798           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-02-20T16:03:32,799           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,800           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,801           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-02-20T16:03:32,801           to the `packages` configuration field.

2025-02-20T16:03:32,802           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,803           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,803           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,804           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,805           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,806           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-02-20T16:03:32,807           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-02-20T16:03:32,807           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,808           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,808           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,810           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,811           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,812           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,813                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,814                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,814                 directory, all directories are treated like packages.
2025-02-20T16:03:32,815           ********************************************************************************

2025-02-20T16:03:32,815   !!
2025-02-20T16:03:32,816     check.warn(importable)
2025-02-20T16:03:32,816   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-02-20T16:03:32,816   !!

2025-02-20T16:03:32,817           ********************************************************************************
2025-02-20T16:03:32,818           ############################
2025-02-20T16:03:32,818           # Package would be ignored #
2025-02-20T16:03:32,818           ############################
2025-02-20T16:03:32,819           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-02-20T16:03:32,819           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,820           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,820           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-02-20T16:03:32,820           to the `packages` configuration field.

2025-02-20T16:03:32,821           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,822           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,822           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,823           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,824           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,825           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-02-20T16:03:32,826           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-02-20T16:03:32,826           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,827           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,828           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,828           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,829           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,831           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,832                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,832                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,833                 directory, all directories are treated like packages.
2025-02-20T16:03:32,833           ********************************************************************************

2025-02-20T16:03:32,834   !!
2025-02-20T16:03:32,835     check.warn(importable)
2025-02-20T16:03:32,835   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-02-20T16:03:32,836   !!

2025-02-20T16:03:32,837           ********************************************************************************
2025-02-20T16:03:32,838           ############################
2025-02-20T16:03:32,838           # Package would be ignored #
2025-02-20T16:03:32,839           ############################
2025-02-20T16:03:32,839           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-02-20T16:03:32,840           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,841           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,842           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-02-20T16:03:32,842           to the `packages` configuration field.

2025-02-20T16:03:32,843           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,843           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,844           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,844           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,845           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,846           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-02-20T16:03:32,846           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-02-20T16:03:32,846           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,847           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,847           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,848           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,848           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,850           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,850                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,850                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,851                 directory, all directories are treated like packages.
2025-02-20T16:03:32,851           ********************************************************************************

2025-02-20T16:03:32,852   !!
2025-02-20T16:03:32,853     check.warn(importable)
2025-02-20T16:03:32,853   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-02-20T16:03:32,854   !!

2025-02-20T16:03:32,855           ********************************************************************************
2025-02-20T16:03:32,856           ############################
2025-02-20T16:03:32,856           # Package would be ignored #
2025-02-20T16:03:32,857           ############################
2025-02-20T16:03:32,857           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-02-20T16:03:32,858           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,859           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,860           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-02-20T16:03:32,860           to the `packages` configuration field.

2025-02-20T16:03:32,862           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,862           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,862           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,863           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,864           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,865           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-02-20T16:03:32,866           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-02-20T16:03:32,866           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,867           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,868           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,869           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,870           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,871           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,871                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,872                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,872                 directory, all directories are treated like packages.
2025-02-20T16:03:32,872           ********************************************************************************

2025-02-20T16:03:32,873   !!
2025-02-20T16:03:32,873     check.warn(importable)
2025-02-20T16:03:32,874   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-02-20T16:03:32,874   !!

2025-02-20T16:03:32,875           ********************************************************************************
2025-02-20T16:03:32,875           ############################
2025-02-20T16:03:32,875           # Package would be ignored #
2025-02-20T16:03:32,876           ############################
2025-02-20T16:03:32,876           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-02-20T16:03:32,876           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,877           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,878           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-02-20T16:03:32,878           to the `packages` configuration field.

2025-02-20T16:03:32,879           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,880           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,880           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,881           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,883           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,883           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-02-20T16:03:32,884           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-02-20T16:03:32,884           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,885           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,886           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,887           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,887           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,889           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,889                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,890                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,890                 directory, all directories are treated like packages.
2025-02-20T16:03:32,891           ********************************************************************************

2025-02-20T16:03:32,892   !!
2025-02-20T16:03:32,892     check.warn(importable)
2025-02-20T16:03:32,893   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-02-20T16:03:32,893   !!

2025-02-20T16:03:32,894           ********************************************************************************
2025-02-20T16:03:32,895           ############################
2025-02-20T16:03:32,896           # Package would be ignored #
2025-02-20T16:03:32,896           ############################
2025-02-20T16:03:32,897           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-02-20T16:03:32,897           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,898           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,898           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-02-20T16:03:32,899           to the `packages` configuration field.

2025-02-20T16:03:32,899           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,900           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,900           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,901           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,902           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,902           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-02-20T16:03:32,903           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-02-20T16:03:32,903           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,904           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,904           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,905           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,906           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,908           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,908                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,909                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,909                 directory, all directories are treated like packages.
2025-02-20T16:03:32,910           ********************************************************************************

2025-02-20T16:03:32,911   !!
2025-02-20T16:03:32,912     check.warn(importable)
2025-02-20T16:03:32,912   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-02-20T16:03:32,913   !!

2025-02-20T16:03:32,914           ********************************************************************************
2025-02-20T16:03:32,915           ############################
2025-02-20T16:03:32,915           # Package would be ignored #
2025-02-20T16:03:32,916           ############################
2025-02-20T16:03:32,916           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-02-20T16:03:32,916           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,917           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,918           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-02-20T16:03:32,918           to the `packages` configuration field.

2025-02-20T16:03:32,919           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,920           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,920           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,921           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,922           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,923           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-02-20T16:03:32,924           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-02-20T16:03:32,925           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,925           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,925           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,926           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,926           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,927           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,928                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,928                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,928                 directory, all directories are treated like packages.
2025-02-20T16:03:32,929           ********************************************************************************

2025-02-20T16:03:32,930   !!
2025-02-20T16:03:32,930     check.warn(importable)
2025-02-20T16:03:32,930   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-02-20T16:03:32,931   !!

2025-02-20T16:03:32,931           ********************************************************************************
2025-02-20T16:03:32,932           ############################
2025-02-20T16:03:32,932           # Package would be ignored #
2025-02-20T16:03:32,933           ############################
2025-02-20T16:03:32,933           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-02-20T16:03:32,933           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,935           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,935           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-02-20T16:03:32,936           to the `packages` configuration field.

2025-02-20T16:03:32,937           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,937           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,938           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,939           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,940           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,941           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-02-20T16:03:32,942           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-02-20T16:03:32,942           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,943           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,943           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,944           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,945           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,946           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,947                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,948                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,948                 directory, all directories are treated like packages.
2025-02-20T16:03:32,949           ********************************************************************************

2025-02-20T16:03:32,950   !!
2025-02-20T16:03:32,950     check.warn(importable)
2025-02-20T16:03:32,951   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-02-20T16:03:32,952   !!

2025-02-20T16:03:32,952           ********************************************************************************
2025-02-20T16:03:32,953           ############################
2025-02-20T16:03:32,953           # Package would be ignored #
2025-02-20T16:03:32,953           ############################
2025-02-20T16:03:32,954           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-02-20T16:03:32,954           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,955           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,955           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-02-20T16:03:32,955           to the `packages` configuration field.

2025-02-20T16:03:32,956           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,956           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,957           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,958           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,958           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,959           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-02-20T16:03:32,959           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-02-20T16:03:32,960           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,960           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,961           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,962           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,963           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,964           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,965                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,965                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,966                 directory, all directories are treated like packages.
2025-02-20T16:03:32,967           ********************************************************************************

2025-02-20T16:03:32,968   !!
2025-02-20T16:03:32,968     check.warn(importable)
2025-02-20T16:03:32,969   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-02-20T16:03:32,969   !!

2025-02-20T16:03:32,970           ********************************************************************************
2025-02-20T16:03:32,970           ############################
2025-02-20T16:03:32,971           # Package would be ignored #
2025-02-20T16:03:32,971           ############################
2025-02-20T16:03:32,972           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-02-20T16:03:32,972           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,973           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,974           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-02-20T16:03:32,975           to the `packages` configuration field.

2025-02-20T16:03:32,976           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,977           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,977           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,978           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,979           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,979           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-02-20T16:03:32,980           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-02-20T16:03:32,980           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:32,980           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:32,981           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:32,982           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:32,982           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:32,983           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:32,984                 even if it does not contain any `.py` files.
2025-02-20T16:03:32,984                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:32,984                 directory, all directories are treated like packages.
2025-02-20T16:03:32,985           ********************************************************************************

2025-02-20T16:03:32,986   !!
2025-02-20T16:03:32,986     check.warn(importable)
2025-02-20T16:03:32,987   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-02-20T16:03:32,987   !!

2025-02-20T16:03:32,988           ********************************************************************************
2025-02-20T16:03:32,989           ############################
2025-02-20T16:03:32,990           # Package would be ignored #
2025-02-20T16:03:32,990           ############################
2025-02-20T16:03:32,991           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-02-20T16:03:32,991           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:32,993           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:32,993           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-02-20T16:03:32,994           to the `packages` configuration field.

2025-02-20T16:03:32,995           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:32,995           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:32,996           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:32,997           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:32,998           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:32,999           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-02-20T16:03:32,999           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-02-20T16:03:33,000           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,000           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,001           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,002           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,003           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,004           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,005                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,005                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,006                 directory, all directories are treated like packages.
2025-02-20T16:03:33,006           ********************************************************************************

2025-02-20T16:03:33,007   !!
2025-02-20T16:03:33,007     check.warn(importable)
2025-02-20T16:03:33,007   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-02-20T16:03:33,008   !!

2025-02-20T16:03:33,008           ********************************************************************************
2025-02-20T16:03:33,009           ############################
2025-02-20T16:03:33,009           # Package would be ignored #
2025-02-20T16:03:33,009           ############################
2025-02-20T16:03:33,010           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-02-20T16:03:33,010           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,011           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,011           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-02-20T16:03:33,011           to the `packages` configuration field.

2025-02-20T16:03:33,012           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,013           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,014           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,015           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,016           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,017           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-02-20T16:03:33,018           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-02-20T16:03:33,019           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,019           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,020           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,021           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,022           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,023           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,024                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,024                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,024                 directory, all directories are treated like packages.
2025-02-20T16:03:33,025           ********************************************************************************

2025-02-20T16:03:33,026   !!
2025-02-20T16:03:33,026     check.warn(importable)
2025-02-20T16:03:33,027   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-02-20T16:03:33,027   !!

2025-02-20T16:03:33,029           ********************************************************************************
2025-02-20T16:03:33,029           ############################
2025-02-20T16:03:33,030           # Package would be ignored #
2025-02-20T16:03:33,030           ############################
2025-02-20T16:03:33,031           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-02-20T16:03:33,031           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,032           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,032           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-02-20T16:03:33,032           to the `packages` configuration field.

2025-02-20T16:03:33,033           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,033           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,034           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,034           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,035           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,036           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-02-20T16:03:33,036           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-02-20T16:03:33,037           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,037           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,038           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,039           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,040           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,042           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,042                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,043                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,043                 directory, all directories are treated like packages.
2025-02-20T16:03:33,044           ********************************************************************************

2025-02-20T16:03:33,045   !!
2025-02-20T16:03:33,046     check.warn(importable)
2025-02-20T16:03:33,046   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-02-20T16:03:33,047   !!

2025-02-20T16:03:33,048           ********************************************************************************
2025-02-20T16:03:33,048           ############################
2025-02-20T16:03:33,049           # Package would be ignored #
2025-02-20T16:03:33,050           ############################
2025-02-20T16:03:33,050           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-02-20T16:03:33,050           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,051           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,052           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-02-20T16:03:33,052           to the `packages` configuration field.

2025-02-20T16:03:33,053           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,054           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,055           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,056           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,057           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,058           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-02-20T16:03:33,058           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-02-20T16:03:33,058           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,059           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,059           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,060           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,061           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,062           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,062                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,062                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,063                 directory, all directories are treated like packages.
2025-02-20T16:03:33,063           ********************************************************************************

2025-02-20T16:03:33,064   !!
2025-02-20T16:03:33,064     check.warn(importable)
2025-02-20T16:03:33,065   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-02-20T16:03:33,065   !!

2025-02-20T16:03:33,067           ********************************************************************************
2025-02-20T16:03:33,067           ############################
2025-02-20T16:03:33,068           # Package would be ignored #
2025-02-20T16:03:33,068           ############################
2025-02-20T16:03:33,069           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-02-20T16:03:33,069           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,071           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,071           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-02-20T16:03:33,072           to the `packages` configuration field.

2025-02-20T16:03:33,073           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,073           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,074           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,075           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,076           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,077           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-02-20T16:03:33,077           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-02-20T16:03:33,078           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,078           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,079           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,080           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,081           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,083           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,084                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,085                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,086                 directory, all directories are treated like packages.
2025-02-20T16:03:33,086           ********************************************************************************

2025-02-20T16:03:33,087   !!
2025-02-20T16:03:33,087     check.warn(importable)
2025-02-20T16:03:33,088   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-02-20T16:03:33,088   !!

2025-02-20T16:03:33,089           ********************************************************************************
2025-02-20T16:03:33,089           ############################
2025-02-20T16:03:33,089           # Package would be ignored #
2025-02-20T16:03:33,090           ############################
2025-02-20T16:03:33,090           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-02-20T16:03:33,090           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,091           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,092           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-02-20T16:03:33,092           to the `packages` configuration field.

2025-02-20T16:03:33,093           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,093           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,094           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,095           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,096           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,097           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-02-20T16:03:33,098           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-02-20T16:03:33,098           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,099           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,099           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,100           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,101           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,103           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,103                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,104                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,104                 directory, all directories are treated like packages.
2025-02-20T16:03:33,105           ********************************************************************************

2025-02-20T16:03:33,106   !!
2025-02-20T16:03:33,106     check.warn(importable)
2025-02-20T16:03:33,107   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-02-20T16:03:33,107   !!

2025-02-20T16:03:33,108           ********************************************************************************
2025-02-20T16:03:33,109           ############################
2025-02-20T16:03:33,109           # Package would be ignored #
2025-02-20T16:03:33,110           ############################
2025-02-20T16:03:33,110           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-02-20T16:03:33,111           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,112           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,113           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-02-20T16:03:33,113           to the `packages` configuration field.

2025-02-20T16:03:33,114           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,114           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,114           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,115           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,116           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,116           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-02-20T16:03:33,117           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-02-20T16:03:33,117           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,117           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,118           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,118           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,119           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,120           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,121                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,121                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,122                 directory, all directories are treated like packages.
2025-02-20T16:03:33,122           ********************************************************************************

2025-02-20T16:03:33,123   !!
2025-02-20T16:03:33,124     check.warn(importable)
2025-02-20T16:03:33,124   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-02-20T16:03:33,125   !!

2025-02-20T16:03:33,126           ********************************************************************************
2025-02-20T16:03:33,126           ############################
2025-02-20T16:03:33,127           # Package would be ignored #
2025-02-20T16:03:33,127           ############################
2025-02-20T16:03:33,128           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-02-20T16:03:33,129           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,130           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,130           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-02-20T16:03:33,131           to the `packages` configuration field.

2025-02-20T16:03:33,131           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,132           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,132           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,134           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,135           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,136           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-02-20T16:03:33,136           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-02-20T16:03:33,137           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,138           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,138           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,139           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,140           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,141           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,142                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,142                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,143                 directory, all directories are treated like packages.
2025-02-20T16:03:33,143           ********************************************************************************

2025-02-20T16:03:33,144   !!
2025-02-20T16:03:33,144     check.warn(importable)
2025-02-20T16:03:33,145   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-02-20T16:03:33,145   !!

2025-02-20T16:03:33,146           ********************************************************************************
2025-02-20T16:03:33,147           ############################
2025-02-20T16:03:33,147           # Package would be ignored #
2025-02-20T16:03:33,147           ############################
2025-02-20T16:03:33,148           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-02-20T16:03:33,148           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,149           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,150           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-02-20T16:03:33,150           to the `packages` configuration field.

2025-02-20T16:03:33,151           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,152           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,152           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,154           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,155           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,155           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-02-20T16:03:33,156           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-02-20T16:03:33,157           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,157           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,158           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,159           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,160           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,161           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,162                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,162                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,163                 directory, all directories are treated like packages.
2025-02-20T16:03:33,163           ********************************************************************************

2025-02-20T16:03:33,164   !!
2025-02-20T16:03:33,165     check.warn(importable)
2025-02-20T16:03:33,165   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-02-20T16:03:33,166   !!

2025-02-20T16:03:33,167           ********************************************************************************
2025-02-20T16:03:33,168           ############################
2025-02-20T16:03:33,168           # Package would be ignored #
2025-02-20T16:03:33,169           ############################
2025-02-20T16:03:33,169           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-02-20T16:03:33,170           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,171           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,171           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-02-20T16:03:33,172           to the `packages` configuration field.

2025-02-20T16:03:33,172           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,173           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,174           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,175           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,175           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,176           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-02-20T16:03:33,177           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-02-20T16:03:33,177           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,178           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,178           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,179           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,180           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,181           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,182                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,183                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,183                 directory, all directories are treated like packages.
2025-02-20T16:03:33,184           ********************************************************************************

2025-02-20T16:03:33,185   !!
2025-02-20T16:03:33,185     check.warn(importable)
2025-02-20T16:03:33,186   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-02-20T16:03:33,186   !!

2025-02-20T16:03:33,188           ********************************************************************************
2025-02-20T16:03:33,188           ############################
2025-02-20T16:03:33,189           # Package would be ignored #
2025-02-20T16:03:33,190           ############################
2025-02-20T16:03:33,190           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-02-20T16:03:33,191           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,192           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,192           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-02-20T16:03:33,193           to the `packages` configuration field.

2025-02-20T16:03:33,194           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,195           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,195           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,196           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,198           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,199           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-02-20T16:03:33,199           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-02-20T16:03:33,200           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,200           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,201           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,202           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,203           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,204           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,204                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,205                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,206                 directory, all directories are treated like packages.
2025-02-20T16:03:33,206           ********************************************************************************

2025-02-20T16:03:33,207   !!
2025-02-20T16:03:33,207     check.warn(importable)
2025-02-20T16:03:33,208   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-02-20T16:03:33,208   !!

2025-02-20T16:03:33,209           ********************************************************************************
2025-02-20T16:03:33,209           ############################
2025-02-20T16:03:33,210           # Package would be ignored #
2025-02-20T16:03:33,210           ############################
2025-02-20T16:03:33,211           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-02-20T16:03:33,211           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,212           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,213           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-02-20T16:03:33,213           to the `packages` configuration field.

2025-02-20T16:03:33,214           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,215           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,215           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,217           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,218           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,219           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-02-20T16:03:33,219           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-02-20T16:03:33,220           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,220           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,221           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,222           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,223           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,224           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,225                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,226                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,226                 directory, all directories are treated like packages.
2025-02-20T16:03:33,227           ********************************************************************************

2025-02-20T16:03:33,228   !!
2025-02-20T16:03:33,228     check.warn(importable)
2025-02-20T16:03:33,229   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-02-20T16:03:33,229   !!

2025-02-20T16:03:33,230           ********************************************************************************
2025-02-20T16:03:33,231           ############################
2025-02-20T16:03:33,231           # Package would be ignored #
2025-02-20T16:03:33,231           ############################
2025-02-20T16:03:33,232           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-02-20T16:03:33,232           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,233           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,234           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-02-20T16:03:33,234           to the `packages` configuration field.

2025-02-20T16:03:33,235           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,235           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,236           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,237           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,238           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,239           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-02-20T16:03:33,239           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-02-20T16:03:33,240           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,240           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,241           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,241           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,242           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,244           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,244                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,245                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,246                 directory, all directories are treated like packages.
2025-02-20T16:03:33,246           ********************************************************************************

2025-02-20T16:03:33,247   !!
2025-02-20T16:03:33,248     check.warn(importable)
2025-02-20T16:03:33,248   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-02-20T16:03:33,249   !!

2025-02-20T16:03:33,250           ********************************************************************************
2025-02-20T16:03:33,250           ############################
2025-02-20T16:03:33,251           # Package would be ignored #
2025-02-20T16:03:33,251           ############################
2025-02-20T16:03:33,252           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-02-20T16:03:33,252           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,253           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,254           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-02-20T16:03:33,254           to the `packages` configuration field.

2025-02-20T16:03:33,255           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,256           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,257           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,258           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,259           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,260           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-02-20T16:03:33,260           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-02-20T16:03:33,260           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,261           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,261           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,262           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,263           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,264           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,265                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,265                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,266                 directory, all directories are treated like packages.
2025-02-20T16:03:33,266           ********************************************************************************

2025-02-20T16:03:33,267   !!
2025-02-20T16:03:33,268     check.warn(importable)
2025-02-20T16:03:33,268   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-02-20T16:03:33,268   !!

2025-02-20T16:03:33,269           ********************************************************************************
2025-02-20T16:03:33,270           ############################
2025-02-20T16:03:33,270           # Package would be ignored #
2025-02-20T16:03:33,271           ############################
2025-02-20T16:03:33,272           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-02-20T16:03:33,272           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,273           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,274           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-02-20T16:03:33,274           to the `packages` configuration field.

2025-02-20T16:03:33,275           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,276           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,276           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,278           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,278           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,279           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-02-20T16:03:33,280           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-02-20T16:03:33,281           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,281           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,282           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,283           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,284           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,286           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,286                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,286                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,287                 directory, all directories are treated like packages.
2025-02-20T16:03:33,287           ********************************************************************************

2025-02-20T16:03:33,288   !!
2025-02-20T16:03:33,288     check.warn(importable)
2025-02-20T16:03:33,289   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-02-20T16:03:33,289   !!

2025-02-20T16:03:33,290           ********************************************************************************
2025-02-20T16:03:33,291           ############################
2025-02-20T16:03:33,291           # Package would be ignored #
2025-02-20T16:03:33,291           ############################
2025-02-20T16:03:33,292           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-02-20T16:03:33,292           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,293           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,294           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-02-20T16:03:33,294           to the `packages` configuration field.

2025-02-20T16:03:33,295           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,296           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,296           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,297           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,298           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,299           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-02-20T16:03:33,300           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-02-20T16:03:33,300           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,301           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,301           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,302           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,303           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,305           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,305                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,306                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,306                 directory, all directories are treated like packages.
2025-02-20T16:03:33,307           ********************************************************************************

2025-02-20T16:03:33,308   !!
2025-02-20T16:03:33,308     check.warn(importable)
2025-02-20T16:03:33,309   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-02-20T16:03:33,310   !!

2025-02-20T16:03:33,311           ********************************************************************************
2025-02-20T16:03:33,311           ############################
2025-02-20T16:03:33,312           # Package would be ignored #
2025-02-20T16:03:33,312           ############################
2025-02-20T16:03:33,313           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-02-20T16:03:33,314           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,315           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,315           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-02-20T16:03:33,316           to the `packages` configuration field.

2025-02-20T16:03:33,317           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,317           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,318           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,318           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,319           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,320           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-02-20T16:03:33,320           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-02-20T16:03:33,321           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,321           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,322           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,323           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,323           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,325           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,325                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,326                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,326                 directory, all directories are treated like packages.
2025-02-20T16:03:33,327           ********************************************************************************

2025-02-20T16:03:33,328   !!
2025-02-20T16:03:33,328     check.warn(importable)
2025-02-20T16:03:33,329   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-02-20T16:03:33,329   !!

2025-02-20T16:03:33,330           ********************************************************************************
2025-02-20T16:03:33,331           ############################
2025-02-20T16:03:33,331           # Package would be ignored #
2025-02-20T16:03:33,332           ############################
2025-02-20T16:03:33,332           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-02-20T16:03:33,333           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,334           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,335           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-02-20T16:03:33,335           to the `packages` configuration field.

2025-02-20T16:03:33,337           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,338           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,338           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,339           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,341           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,342           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-02-20T16:03:33,343           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-02-20T16:03:33,344           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,345           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,345           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,346           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,347           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,349           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,350                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,350                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,351                 directory, all directories are treated like packages.
2025-02-20T16:03:33,352           ********************************************************************************

2025-02-20T16:03:33,353   !!
2025-02-20T16:03:33,354     check.warn(importable)
2025-02-20T16:03:33,354   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-02-20T16:03:33,355   !!

2025-02-20T16:03:33,356           ********************************************************************************
2025-02-20T16:03:33,356           ############################
2025-02-20T16:03:33,357           # Package would be ignored #
2025-02-20T16:03:33,358           ############################
2025-02-20T16:03:33,359           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-02-20T16:03:33,359           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,361           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,361           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-02-20T16:03:33,362           to the `packages` configuration field.

2025-02-20T16:03:33,363           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,364           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,365           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,366           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,368           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,369           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-02-20T16:03:33,370           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-02-20T16:03:33,370           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,371           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,372           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,373           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,374           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,376           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,377                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,378                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,378                 directory, all directories are treated like packages.
2025-02-20T16:03:33,379           ********************************************************************************

2025-02-20T16:03:33,380   !!
2025-02-20T16:03:33,381     check.warn(importable)
2025-02-20T16:03:33,381   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-02-20T16:03:33,382   !!

2025-02-20T16:03:33,383           ********************************************************************************
2025-02-20T16:03:33,384           ############################
2025-02-20T16:03:33,384           # Package would be ignored #
2025-02-20T16:03:33,385           ############################
2025-02-20T16:03:33,386           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-02-20T16:03:33,386           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,387           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,388           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-02-20T16:03:33,388           to the `packages` configuration field.

2025-02-20T16:03:33,390           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,390           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,391           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,392           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,393           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,394           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-02-20T16:03:33,395           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-02-20T16:03:33,396           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,396           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,397           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,398           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,400           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,402           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,402                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,403                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,404                 directory, all directories are treated like packages.
2025-02-20T16:03:33,404           ********************************************************************************

2025-02-20T16:03:33,406   !!
2025-02-20T16:03:33,406     check.warn(importable)
2025-02-20T16:03:33,407   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-02-20T16:03:33,407   !!

2025-02-20T16:03:33,409           ********************************************************************************
2025-02-20T16:03:33,410           ############################
2025-02-20T16:03:33,410           # Package would be ignored #
2025-02-20T16:03:33,411           ############################
2025-02-20T16:03:33,412           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-02-20T16:03:33,412           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,414           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,415           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-02-20T16:03:33,415           to the `packages` configuration field.

2025-02-20T16:03:33,417           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,417           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,418           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,419           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,421           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,422           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-02-20T16:03:33,422           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-02-20T16:03:33,423           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,423           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,424           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,425           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,427           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,428           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,429                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,430                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,430                 directory, all directories are treated like packages.
2025-02-20T16:03:33,431           ********************************************************************************

2025-02-20T16:03:33,432   !!
2025-02-20T16:03:33,432     check.warn(importable)
2025-02-20T16:03:33,433   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-02-20T16:03:33,434   !!

2025-02-20T16:03:33,436           ********************************************************************************
2025-02-20T16:03:33,436           ############################
2025-02-20T16:03:33,437           # Package would be ignored #
2025-02-20T16:03:33,438           ############################
2025-02-20T16:03:33,438           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-02-20T16:03:33,439           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,440           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,441           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-02-20T16:03:33,442           to the `packages` configuration field.

2025-02-20T16:03:33,442           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,443           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,444           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,445           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,446           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,447           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-02-20T16:03:33,447           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-02-20T16:03:33,448           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,448           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,449           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,450           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,451           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,453           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,453                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,454                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,454                 directory, all directories are treated like packages.
2025-02-20T16:03:33,455           ********************************************************************************

2025-02-20T16:03:33,456   !!
2025-02-20T16:03:33,456     check.warn(importable)
2025-02-20T16:03:33,456   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-02-20T16:03:33,457   !!

2025-02-20T16:03:33,458           ********************************************************************************
2025-02-20T16:03:33,458           ############################
2025-02-20T16:03:33,459           # Package would be ignored #
2025-02-20T16:03:33,459           ############################
2025-02-20T16:03:33,460           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-02-20T16:03:33,460           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,461           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,462           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-02-20T16:03:33,462           to the `packages` configuration field.

2025-02-20T16:03:33,463           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,463           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,464           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,465           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,466           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,467           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-02-20T16:03:33,468           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-02-20T16:03:33,468           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,469           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,469           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,470           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,471           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,473           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,473                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,474                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,475                 directory, all directories are treated like packages.
2025-02-20T16:03:33,475           ********************************************************************************

2025-02-20T16:03:33,476   !!
2025-02-20T16:03:33,477     check.warn(importable)
2025-02-20T16:03:33,477   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-02-20T16:03:33,478   !!

2025-02-20T16:03:33,479           ********************************************************************************
2025-02-20T16:03:33,479           ############################
2025-02-20T16:03:33,480           # Package would be ignored #
2025-02-20T16:03:33,480           ############################
2025-02-20T16:03:33,481           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-02-20T16:03:33,481           but it is absent from setuptools' `packages` configuration.

2025-02-20T16:03:33,483           This leads to an ambiguous overall configuration. If you want to distribute this
2025-02-20T16:03:33,483           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-02-20T16:03:33,483           to the `packages` configuration field.

2025-02-20T16:03:33,484           Alternatively, you can also rely on setuptools' discovery methods
2025-02-20T16:03:33,485           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-02-20T16:03:33,485           instead of `find_packages(...)`/`find:`).

2025-02-20T16:03:33,486           You can read more about "package discovery" on setuptools documentation page:

2025-02-20T16:03:33,487           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-02-20T16:03:33,488           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-02-20T16:03:33,488           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-02-20T16:03:33,489           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-02-20T16:03:33,489           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-02-20T16:03:33,490           combination with a more fine grained `package-data` configuration.

2025-02-20T16:03:33,490           You can read more about "package data files" on setuptools documentation page:

2025-02-20T16:03:33,491           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-02-20T16:03:33,493           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-02-20T16:03:33,493                 even if it does not contain any `.py` files.
2025-02-20T16:03:33,494                 On the other hand, currently there is no concept of package data
2025-02-20T16:03:33,494                 directory, all directories are treated like packages.
2025-02-20T16:03:33,495           ********************************************************************************

2025-02-20T16:03:33,496   !!
2025-02-20T16:03:33,496     check.warn(importable)
2025-02-20T16:03:33,497   creating build/lib/deepspeed/autotuning/config_templates
2025-02-20T16:03:33,498   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-02-20T16:03:33,498   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-02-20T16:03:33,498   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-02-20T16:03:33,499   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-02-20T16:03:33,500   creating build/lib/deepspeed/ops/csrc/adagrad
2025-02-20T16:03:33,500   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-02-20T16:03:33,501   creating build/lib/deepspeed/ops/csrc/adam
2025-02-20T16:03:33,501   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-02-20T16:03:33,502   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-02-20T16:03:33,502   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-02-20T16:03:33,503   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-02-20T16:03:33,503   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-02-20T16:03:33,504   creating build/lib/deepspeed/ops/csrc/aio/common
2025-02-20T16:03:33,504   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-02-20T16:03:33,505   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-02-20T16:03:33,506   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-02-20T16:03:33,506   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-02-20T16:03:33,507   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-02-20T16:03:33,507   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-02-20T16:03:33,508   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,508   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,509   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,509   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,509   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,510   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,510   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,511   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,511   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,511   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,512   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,513   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,513   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,514   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,514   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,515   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,515   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,516   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:33,516   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-02-20T16:03:33,517   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-02-20T16:03:33,517   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-02-20T16:03:33,518   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-02-20T16:03:33,518   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:33,519   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:33,519   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:33,520   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:33,520   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:33,521   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-02-20T16:03:33,522   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-02-20T16:03:33,522   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:33,523   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:33,523   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:33,524   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:33,525   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:33,525   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:33,525   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:33,526   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:33,526   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:33,527   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:33,527   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:33,527   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:33,528   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:33,528   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:33,529   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:33,530   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:33,530   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:33,531   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:33,531   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:33,532   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:33,532   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:33,533   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:33,534   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:33,534   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:33,535   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:33,535   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:33,536   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:33,536   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:33,537   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-02-20T16:03:33,538   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-02-20T16:03:33,538   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-02-20T16:03:33,539   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-02-20T16:03:33,539   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-02-20T16:03:33,540   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-02-20T16:03:33,540   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-02-20T16:03:33,540   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-02-20T16:03:33,541   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-02-20T16:03:33,541   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:33,542   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:33,542   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:33,543   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:33,543   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:33,544   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:33,545   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:33,545   creating build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,546   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,546   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,547   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,548   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,548   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,549   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,549   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,550   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,550   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,551   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,551   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,552   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,553   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,553   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,554   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,555   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,555   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,555   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,556   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,556   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,557   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,557   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,558   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,559   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,559   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,560   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,562   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,564   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,567   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-02-20T16:03:33,570   creating build/lib/deepspeed/ops/csrc/lamb
2025-02-20T16:03:33,571   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-02-20T16:03:33,574   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-02-20T16:03:33,577   creating build/lib/deepspeed/ops/csrc/lion
2025-02-20T16:03:33,578   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-02-20T16:03:33,580   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-02-20T16:03:33,582   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-02-20T16:03:33,584   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-02-20T16:03:33,587   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-02-20T16:03:33,590   creating build/lib/deepspeed/ops/csrc/quantization
2025-02-20T16:03:33,591   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-02-20T16:03:33,593   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-02-20T16:03:33,596   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-02-20T16:03:33,599   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-02-20T16:03:33,603   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-02-20T16:03:33,606   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-02-20T16:03:33,608   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-02-20T16:03:33,611   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:33,612   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:33,615   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:33,618   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:33,621   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:33,624   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-02-20T16:03:33,625   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-02-20T16:03:33,628   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-02-20T16:03:33,630   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-02-20T16:03:33,633   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-02-20T16:03:33,635   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-02-20T16:03:33,637   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-02-20T16:03:33,639   creating build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,640   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,644   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,647   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,651   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,654   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,658   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,662   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,666   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-02-20T16:03:33,669   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,671   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,675   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,678   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,681   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,684   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,687   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,692   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,695   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,698   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,701   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:33,705   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-02-20T16:03:33,707   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-02-20T16:03:33,710   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-02-20T16:03:33,714   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-02-20T16:03:33,717   creating build/lib/deepspeed/ops/csrc/utils
2025-02-20T16:03:33,719   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-02-20T16:03:33,721   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-02-20T16:03:33,723   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-02-20T16:03:33,726   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-02-20T16:03:33,728   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-02-20T16:03:33,730   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-02-20T16:03:33,733   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-02-20T16:03:33,736   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-02-20T16:03:33,738   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-02-20T16:03:33,740   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:33,742   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:33,744   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:33,747   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:33,750   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:33,753   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:33,756   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-02-20T16:03:33,758   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-02-20T16:03:33,761   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:33,764   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:33,766   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:33,769   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-02-20T16:03:33,770   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-02-20T16:03:33,773   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-02-20T16:03:33,776   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-02-20T16:03:33,777   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-02-20T16:03:33,780   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:33,781   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:33,784   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:33,786   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:33,789   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:33,792   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:33,795   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-02-20T16:03:33,797   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-02-20T16:03:33,799   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-02-20T16:03:33,800   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-02-20T16:03:33,802   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-02-20T16:03:33,804   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-02-20T16:03:33,805   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-02-20T16:03:33,807   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-02-20T16:03:33,809   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-02-20T16:03:33,811   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-02-20T16:03:33,813   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-02-20T16:03:33,815   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:33,817   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:33,819   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:33,828   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:33,834   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:33,838   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:33,841   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:33,843   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:33,846   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:33,849   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,850   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,853   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,856   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,859   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,862   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,865   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,868   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,871   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,873   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:33,876   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:33,879   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:33,882   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:33,885   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:33,887   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:33,890   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:33,893   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:33,896   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:33,899   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:33,901   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:33,904   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:33,907   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:33,909   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:33,912   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:33,914   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:33,917   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:33,920   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:33,922   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:33,925   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:33,928   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:33,930   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:33,933   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:33,936   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:33,939   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:33,941   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:33,944   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:33,947   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:33,949   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:33,951   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:33,955   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:33,957   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:33,960   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:33,962   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:33,965   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:33,968   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:33,971   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:33,973   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:33,976   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:33,979   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:33,981   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:33,983   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:33,986   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:33,989   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:33,992   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:33,995   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:34,050   running build_scripts
2025-02-20T16:03:34,051   creating build/scripts-3.11
2025-02-20T16:03:34,053   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-02-20T16:03:34,055   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-02-20T16:03:34,056   copying and adjusting bin/ds -> build/scripts-3.11
2025-02-20T16:03:34,058   copying bin/ds_ssh -> build/scripts-3.11
2025-02-20T16:03:34,060   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-02-20T16:03:34,062   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-02-20T16:03:34,064   copying and adjusting bin/dsr -> build/scripts-3.11
2025-02-20T16:03:34,066   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-02-20T16:03:34,068   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-02-20T16:03:34,070   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-02-20T16:03:34,071   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-02-20T16:03:34,072   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-02-20T16:03:34,073   changing mode of build/scripts-3.11/ds from 644 to 755
2025-02-20T16:03:34,073   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-02-20T16:03:34,074   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-02-20T16:03:34,074   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-02-20T16:03:34,075   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-02-20T16:03:34,075   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-02-20T16:03:34,076   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-02-20T16:03:34,102   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-02-20T16:03:34,103   !!

2025-02-20T16:03:34,104           ********************************************************************************
2025-02-20T16:03:34,104           Please avoid running ``setup.py`` directly.
2025-02-20T16:03:34,105           Instead, use pypa/build, pypa/installer or other
2025-02-20T16:03:34,106           standards-based tools.

2025-02-20T16:03:34,107           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-02-20T16:03:34,107           ********************************************************************************

2025-02-20T16:03:34,108   !!
2025-02-20T16:03:34,109     self.initialize_options()
2025-02-20T16:03:34,129   installing to build/bdist.linux-armv7l/wheel
2025-02-20T16:03:34,130   running install
2025-02-20T16:03:34,155   running install_lib
2025-02-20T16:03:34,182   creating build/bdist.linux-armv7l/wheel
2025-02-20T16:03:34,184   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-02-20T16:03:34,186   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-02-20T16:03:34,187   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-02-20T16:03:34,190   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-02-20T16:03:34,193   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-02-20T16:03:34,194   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-02-20T16:03:34,196   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-02-20T16:03:34,198   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-02-20T16:03:34,200   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-02-20T16:03:34,201   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,203   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,205   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,207   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,208   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,210   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,212   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,214   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,215   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,217   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-02-20T16:03:34,219   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-02-20T16:03:34,220   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-02-20T16:03:34,222   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-02-20T16:03:34,224   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-02-20T16:03:34,226   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-02-20T16:03:34,227   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-02-20T16:03:34,229   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-02-20T16:03:34,231   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-02-20T16:03:34,234   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-02-20T16:03:34,235   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-02-20T16:03:34,238   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-02-20T16:03:34,240   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-02-20T16:03:34,242   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-02-20T16:03:34,244   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-02-20T16:03:34,246   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-02-20T16:03:34,249   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-02-20T16:03:34,250   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-02-20T16:03:34,252   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-02-20T16:03:34,254   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-02-20T16:03:34,256   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-02-20T16:03:34,257   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-02-20T16:03:34,259   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-02-20T16:03:34,263   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-02-20T16:03:34,264   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,266   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,268   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,270   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,272   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,274   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,276   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,278   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,279   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,281   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,283   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,285   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-02-20T16:03:34,288   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-02-20T16:03:34,289   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,291   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,294   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,296   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,297   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,299   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,302   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,304   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,306   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,308   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,310   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,312   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,314   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,316   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,319   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,320   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,323   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,325   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-02-20T16:03:34,327   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-02-20T16:03:34,330   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-02-20T16:03:34,331   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-02-20T16:03:34,334   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-02-20T16:03:34,336   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-02-20T16:03:34,338   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-02-20T16:03:34,339   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-02-20T16:03:34,342   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-02-20T16:03:34,343   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-02-20T16:03:34,345   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-02-20T16:03:34,348   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-02-20T16:03:34,349   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-02-20T16:03:34,351   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-02-20T16:03:34,353   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-02-20T16:03:34,355   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-02-20T16:03:34,357   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-02-20T16:03:34,359   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-02-20T16:03:34,361   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-02-20T16:03:34,363   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-02-20T16:03:34,365   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-02-20T16:03:34,367   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-02-20T16:03:34,371   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-02-20T16:03:34,372   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-02-20T16:03:34,374   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-02-20T16:03:34,376   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-02-20T16:03:34,378   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-02-20T16:03:34,380   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-02-20T16:03:34,381   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,384   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,386   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,388   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,390   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,392   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,394   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,396   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,398   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,400   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-02-20T16:03:34,404   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-02-20T16:03:34,405   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-02-20T16:03:34,407   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-02-20T16:03:34,409   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-02-20T16:03:34,411   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-02-20T16:03:34,413   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-02-20T16:03:34,415   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-02-20T16:03:34,416   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-02-20T16:03:34,418   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-02-20T16:03:34,420   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-02-20T16:03:34,423   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-02-20T16:03:34,425   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-02-20T16:03:34,426   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-02-20T16:03:34,428   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-02-20T16:03:34,429   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-02-20T16:03:34,431   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-02-20T16:03:34,435   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-02-20T16:03:34,436   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-02-20T16:03:34,438   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-02-20T16:03:34,440   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-02-20T16:03:34,442   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-02-20T16:03:34,443   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-02-20T16:03:34,445   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-02-20T16:03:34,447   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-02-20T16:03:34,448   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-02-20T16:03:34,451   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,452   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,454   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,456   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,457   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,459   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,461   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,463   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,465   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,467   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,469   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-02-20T16:03:34,471   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,473   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,475   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,476   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,479   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,480   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,482   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,484   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,486   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,488   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,490   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,491   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,494   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-02-20T16:03:34,495   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-02-20T16:03:34,497   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-02-20T16:03:34,499   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-02-20T16:03:34,500   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-02-20T16:03:34,502   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-02-20T16:03:34,504   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-02-20T16:03:34,506   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,508   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-02-20T16:03:34,509   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-02-20T16:03:34,511   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-02-20T16:03:34,513   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-02-20T16:03:34,515   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-02-20T16:03:34,517   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-02-20T16:03:34,518   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-02-20T16:03:34,520   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-02-20T16:03:34,522   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,525   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,526   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,528   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,531   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,533   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,535   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,537   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,539   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,541   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,543   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-02-20T16:03:34,545   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,546   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,548   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,550   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,552   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,554   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,556   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,557   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,559   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,562   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-02-20T16:03:34,564   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-02-20T16:03:34,566   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-02-20T16:03:34,568   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:34,569   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:34,571   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:34,574   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:34,576   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:34,578   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:34,580   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-02-20T16:03:34,583   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-02-20T16:03:34,584   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-02-20T16:03:34,588   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-02-20T16:03:34,589   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-02-20T16:03:34,591   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-02-20T16:03:34,594   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-02-20T16:03:34,595   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-02-20T16:03:34,598   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-02-20T16:03:34,599   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-02-20T16:03:34,602   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:34,603   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:34,606   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:34,607   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:34,610   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:34,612   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-02-20T16:03:34,615   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-02-20T16:03:34,616   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-02-20T16:03:34,619   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-02-20T16:03:34,621   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-02-20T16:03:34,623   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-02-20T16:03:34,624   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-02-20T16:03:34,627   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-02-20T16:03:34,628   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-02-20T16:03:34,630   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-02-20T16:03:34,632   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-02-20T16:03:34,634   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-02-20T16:03:34,636   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-02-20T16:03:34,639   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-02-20T16:03:34,640   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-02-20T16:03:34,643   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-02-20T16:03:34,645   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-02-20T16:03:34,647   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-02-20T16:03:34,648   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-02-20T16:03:34,650   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-02-20T16:03:34,652   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-02-20T16:03:34,654   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-02-20T16:03:34,657   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-02-20T16:03:34,659   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-02-20T16:03:34,661   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-02-20T16:03:34,662   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-02-20T16:03:34,665   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,666   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,668   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,670   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,672   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,674   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,676   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,678   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,679   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,681   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,683   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,685   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,687   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,690   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,691   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,693   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,695   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,697   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-02-20T16:03:34,700   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:34,701   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:34,703   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:34,706   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:34,709   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-02-20T16:03:34,712   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-02-20T16:03:34,713   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-02-20T16:03:34,715   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-02-20T16:03:34,718   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-02-20T16:03:34,720   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-02-20T16:03:34,723   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-02-20T16:03:34,725   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-02-20T16:03:34,729   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-02-20T16:03:34,732   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-02-20T16:03:34,733   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-02-20T16:03:34,736   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-02-20T16:03:34,737   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-02-20T16:03:34,739   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-02-20T16:03:34,742   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-02-20T16:03:34,744   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,745   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,748   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,750   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,753   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,756   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,760   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-02-20T16:03:34,762   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,763   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,766   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,769   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,771   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,775   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,777   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,779   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,782   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,785   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,787   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-02-20T16:03:34,791   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-02-20T16:03:34,792   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-02-20T16:03:34,795   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-02-20T16:03:34,797   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-02-20T16:03:34,799   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,802   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,804   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-02-20T16:03:34,807   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-02-20T16:03:34,809   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-02-20T16:03:34,810   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-02-20T16:03:34,813   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-02-20T16:03:34,816   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-02-20T16:03:34,817   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-02-20T16:03:34,819   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-02-20T16:03:34,820   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-02-20T16:03:34,822   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-02-20T16:03:34,824   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:34,826   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:34,828   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:34,831   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:34,834   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-02-20T16:03:34,837   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-02-20T16:03:34,838   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-02-20T16:03:34,840   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-02-20T16:03:34,842   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:34,844   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-02-20T16:03:34,846   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-02-20T16:03:34,848   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-02-20T16:03:34,850   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:34,853   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:34,856   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:34,858   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:34,861   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:34,864   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:34,866   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-02-20T16:03:34,870   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:34,872   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:34,875   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:34,877   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:34,881   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:34,884   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:34,887   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:34,891   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-02-20T16:03:34,895   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:34,897   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:34,902   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:34,905   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-02-20T16:03:34,910   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:34,912   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:34,915   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:34,917   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:34,921   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:34,923   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:34,928   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:34,931   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-02-20T16:03:34,935   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-02-20T16:03:34,936   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,939   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,941   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,944   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,946   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,948   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,951   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,953   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,955   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,957   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,958   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,960   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,963   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,965   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,968   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,970   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,972   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,974   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,977   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,979   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,981   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,983   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,985   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,987   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,989   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,991   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,994   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,996   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:34,998   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-02-20T16:03:35,000   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-02-20T16:03:35,002   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-02-20T16:03:35,004   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-02-20T16:03:35,006   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-02-20T16:03:35,008   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-02-20T16:03:35,010   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-02-20T16:03:35,013   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-02-20T16:03:35,014   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-02-20T16:03:35,017   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-02-20T16:03:35,018   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-02-20T16:03:35,021   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-02-20T16:03:35,023   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-02-20T16:03:35,025   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-02-20T16:03:35,027   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-02-20T16:03:35,028   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-02-20T16:03:35,031   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-02-20T16:03:35,033   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-02-20T16:03:35,034   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-02-20T16:03:35,037   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-02-20T16:03:35,038   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-02-20T16:03:35,040   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-02-20T16:03:35,042   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-02-20T16:03:35,044   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-02-20T16:03:35,045   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-02-20T16:03:35,047   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-02-20T16:03:35,049   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-02-20T16:03:35,051   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-02-20T16:03:35,053   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-02-20T16:03:35,055   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-02-20T16:03:35,056   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-02-20T16:03:35,059   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-02-20T16:03:35,060   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-02-20T16:03:35,063   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-02-20T16:03:35,064   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,066   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,068   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,071   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,072   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,075   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,077   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,079   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,082   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,083   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,086   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,088   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,090   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,092   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-02-20T16:03:35,094   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,096   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,098   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,100   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,103   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,106   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,107   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,110   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,112   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,114   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,116   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,118   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,120   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,123   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,125   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,127   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,129   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,131   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,134   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,136   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,138   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,140   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,143   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,144   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,146   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,148   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,150   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,151   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,153   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-02-20T16:03:35,155   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,158   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-02-20T16:03:35,160   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-02-20T16:03:35,163   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-02-20T16:03:35,164   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-02-20T16:03:35,166   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-02-20T16:03:35,169   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-02-20T16:03:35,170   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-02-20T16:03:35,173   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-02-20T16:03:35,175   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-02-20T16:03:35,176   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-02-20T16:03:35,179   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-02-20T16:03:35,180   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-02-20T16:03:35,182   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-02-20T16:03:35,185   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-02-20T16:03:35,187   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-02-20T16:03:35,189   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-02-20T16:03:35,192   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:35,193   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:35,195   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:35,197   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:35,199   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-02-20T16:03:35,201   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-02-20T16:03:35,203   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-02-20T16:03:35,206   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-02-20T16:03:35,209   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-02-20T16:03:35,210   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,213   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,216   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,219   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-02-20T16:03:35,220   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-02-20T16:03:35,222   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-02-20T16:03:35,225   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,228   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,230   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,233   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2025-02-20T16:03:35,234   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-02-20T16:03:35,236   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-02-20T16:03:35,238   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-02-20T16:03:35,240   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,242   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,243   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,246   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,248   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,249   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,252   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,254   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,256   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,259   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-02-20T16:03:35,261   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,264   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-02-20T16:03:35,265   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-02-20T16:03:35,268   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-02-20T16:03:35,270   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-02-20T16:03:35,272   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-02-20T16:03:35,275   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-02-20T16:03:35,276   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-02-20T16:03:35,279   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-02-20T16:03:35,280   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-02-20T16:03:35,283   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-02-20T16:03:35,286   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,290   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,293   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,295   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-02-20T16:03:35,297   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,299   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,301   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,303   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,309   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,311   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,315   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,317   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,319   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,322   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,324   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,326   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,329   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,331   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,335   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,337   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,339   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-02-20T16:03:35,340   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,343   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,345   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,348   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-02-20T16:03:35,349   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-02-20T16:03:35,350   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-02-20T16:03:35,353   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-02-20T16:03:35,354   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-02-20T16:03:35,357   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-02-20T16:03:35,359   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-02-20T16:03:35,361   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-02-20T16:03:35,363   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-02-20T16:03:35,366   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-02-20T16:03:35,369   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-02-20T16:03:35,370   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-02-20T16:03:35,373   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-02-20T16:03:35,375   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-02-20T16:03:35,378   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-02-20T16:03:35,381   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-02-20T16:03:35,384   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-02-20T16:03:35,386   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,388   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,391   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:35,392   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:35,395   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:35,397   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:35,399   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-02-20T16:03:35,401   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-02-20T16:03:35,402   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-02-20T16:03:35,404   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-02-20T16:03:35,406   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-02-20T16:03:35,409   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,411   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,413   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-02-20T16:03:35,416   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-02-20T16:03:35,417   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-02-20T16:03:35,419   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-02-20T16:03:35,422   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-02-20T16:03:35,423   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-02-20T16:03:35,426   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:35,427   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:35,430   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:35,432   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:35,435   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:35,436   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-02-20T16:03:35,440   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:35,441   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:35,443   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:35,445   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:35,447   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:35,449   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-02-20T16:03:35,453   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-02-20T16:03:35,674   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-02-20T16:03:35,678   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-02-20T16:03:35,681   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-02-20T16:03:35,685   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-02-20T16:03:35,687   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-02-20T16:03:35,690   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-02-20T16:03:35,693   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-02-20T16:03:35,696   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-02-20T16:03:35,701   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-02-20T16:03:35,702   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-02-20T16:03:35,707   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-02-20T16:03:35,709   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-02-20T16:03:35,712   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:35,715   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:35,718   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:35,720   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:35,723   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-02-20T16:03:35,726   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:35,728   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:35,731   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:35,733   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:35,735   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-02-20T16:03:35,738   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-02-20T16:03:35,743   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:35,745   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:35,747   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:35,750   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:35,753   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-02-20T16:03:35,757   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:35,759   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:35,762   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:35,765   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:35,767   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-02-20T16:03:35,770   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-02-20T16:03:35,771   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-02-20T16:03:35,776   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,777   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,779   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,781   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,783   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,786   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,789   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,793   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,795   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,796   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-02-20T16:03:35,798   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-02-20T16:03:35,801   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-02-20T16:03:35,803   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-02-20T16:03:35,812   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:35,813   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:35,815   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:35,817   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:35,819   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-02-20T16:03:35,822   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:35,823   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:35,825   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:35,827   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:35,829   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-02-20T16:03:35,832   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:35,833   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:35,835   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:35,837   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:35,840   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-02-20T16:03:35,843   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:35,844   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:35,846   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:35,848   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:35,850   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-02-20T16:03:35,853   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:35,854   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:35,856   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:35,858   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:35,860   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-02-20T16:03:35,863   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,865   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,867   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,869   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,872   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,874   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,876   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,878   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,880   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,882   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-02-20T16:03:35,885   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:35,886   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:35,888   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:35,890   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:35,892   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-02-20T16:03:35,895   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-02-20T16:03:35,898   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-02-20T16:03:35,900   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-02-20T16:03:35,902   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-02-20T16:03:35,905   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-02-20T16:03:35,906   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-02-20T16:03:35,908   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-02-20T16:03:35,910   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-02-20T16:03:35,912   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-02-20T16:03:35,915   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-02-20T16:03:35,918   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-02-20T16:03:35,920   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-02-20T16:03:35,922   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-02-20T16:03:35,924   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-02-20T16:03:35,926   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:35,929   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-02-20T16:03:35,930   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-02-20T16:03:35,933   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-02-20T16:03:35,935   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:35,936   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:35,938   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:35,940   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:35,942   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:35,945   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-02-20T16:03:35,947   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:35,949   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:35,951   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:35,953   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:35,955   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-02-20T16:03:35,959   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:35,960   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:35,962   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:35,965   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:35,968   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:35,971   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,972   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,977   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,981   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,984   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,986   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,988   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,991   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,993   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,995   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-02-20T16:03:35,998   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:36,000   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-02-20T16:03:36,003   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-02-20T16:03:36,005   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-02-20T16:03:36,008   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:36,010   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:36,012   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:36,014   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:36,016   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:36,018   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:36,020   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:36,022   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-02-20T16:03:36,025   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,026   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,028   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,030   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,032   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,035   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,037   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,039   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,041   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-02-20T16:03:36,043   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:36,044   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:36,046   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:36,048   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:36,050   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:36,053   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-02-20T16:03:36,055   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-02-20T16:03:36,057   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-02-20T16:03:36,060   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:36,061   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:36,064   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:36,065   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:36,067   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:36,069   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-02-20T16:03:36,071   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-02-20T16:03:36,074   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:36,075   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:36,078   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:36,079   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:36,082   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:36,084   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:36,086   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-02-20T16:03:36,088   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-02-20T16:03:36,090   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-02-20T16:03:36,092   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-02-20T16:03:36,095   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-02-20T16:03:36,097   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:36,098   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:36,100   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:36,102   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:36,104   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-02-20T16:03:36,107   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:36,108   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:36,110   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:36,113   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:36,115   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:36,117   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:36,119   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-02-20T16:03:36,122   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:36,123   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:36,127   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:36,129   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:36,131   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:36,134   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:36,136   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-02-20T16:03:36,138   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:36,140   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:36,142   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:36,144   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:36,146   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:36,148   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:36,150   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-02-20T16:03:36,152   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-02-20T16:03:36,155   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-02-20T16:03:36,156   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-02-20T16:03:36,158   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-02-20T16:03:36,160   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-02-20T16:03:36,163   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:36,164   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:36,166   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:36,169   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:36,170   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:36,172   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:36,174   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-02-20T16:03:36,176   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-02-20T16:03:36,179   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:36,180   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:36,182   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:36,184   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:36,186   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:36,188   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:36,190   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-02-20T16:03:36,193   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:36,194   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:36,196   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:36,198   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:36,200   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:36,202   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:36,203   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-02-20T16:03:36,206   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-02-20T16:03:36,207   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-02-20T16:03:36,210   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,211   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,213   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,215   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,218   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,220   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,222   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,225   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,227   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-02-20T16:03:36,229   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:36,230   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:36,234   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:36,237   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:36,239   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:36,242   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-02-20T16:03:36,244   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:36,246   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:36,248   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:36,250   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:36,252   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:36,254   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:36,257   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-02-20T16:03:36,258   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-02-20T16:03:36,261   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-02-20T16:03:36,263   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-02-20T16:03:36,264   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-02-20T16:03:36,267   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-02-20T16:03:36,270   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-02-20T16:03:36,271   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-02-20T16:03:36,273   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-02-20T16:03:36,275   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-02-20T16:03:36,278   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-02-20T16:03:36,280   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-02-20T16:03:36,282   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-02-20T16:03:36,283   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-02-20T16:03:36,286   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-02-20T16:03:36,289   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-02-20T16:03:36,290   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-02-20T16:03:36,292   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-02-20T16:03:36,295   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-02-20T16:03:36,296   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-02-20T16:03:36,298   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-02-20T16:03:36,301   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-02-20T16:03:36,302   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-02-20T16:03:36,304   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-02-20T16:03:36,307   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-02-20T16:03:36,308   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-02-20T16:03:36,310   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-02-20T16:03:36,313   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-02-20T16:03:36,314   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-02-20T16:03:36,316   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-02-20T16:03:36,318   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-02-20T16:03:36,320   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-02-20T16:03:36,322   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-02-20T16:03:36,324   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-02-20T16:03:36,326   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-02-20T16:03:36,328   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-02-20T16:03:36,330   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-02-20T16:03:36,332   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,333   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,336   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,338   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,340   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,342   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,343   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,345   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,347   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-02-20T16:03:36,349   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-02-20T16:03:36,352   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-02-20T16:03:36,353   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-02-20T16:03:36,355   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-02-20T16:03:36,357   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-02-20T16:03:36,359   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-02-20T16:03:36,361   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:36,363   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-02-20T16:03:36,366   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-02-20T16:03:36,367   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-02-20T16:03:36,369   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-02-20T16:03:36,372   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-02-20T16:03:36,374   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-02-20T16:03:36,376   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-02-20T16:03:36,378   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-02-20T16:03:36,380   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-02-20T16:03:36,383   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-02-20T16:03:36,384   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-02-20T16:03:36,387   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-02-20T16:03:36,388   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-02-20T16:03:36,391   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-02-20T16:03:36,393   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-02-20T16:03:36,396   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-02-20T16:03:36,398   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-02-20T16:03:36,400   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-02-20T16:03:36,403   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-02-20T16:03:36,405   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,407   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,410   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,412   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,414   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,416   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,418   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,420   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,423   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-02-20T16:03:36,426   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-02-20T16:03:36,428   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-02-20T16:03:36,430   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-02-20T16:03:36,433   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-02-20T16:03:36,435   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-02-20T16:03:36,438   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-02-20T16:03:36,440   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-02-20T16:03:36,444   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-02-20T16:03:36,445   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,448   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,450   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,452   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,454   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,456   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,459   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,461   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,463   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,466   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,468   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,471   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,475   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-02-20T16:03:36,476   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,479   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,482   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,484   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,487   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-02-20T16:03:36,489   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-02-20T16:03:36,492   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-02-20T16:03:36,495   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-02-20T16:03:36,497   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-02-20T16:03:36,499   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-02-20T16:03:36,502   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-02-20T16:03:36,504   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-02-20T16:03:36,507   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,510   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,513   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,515   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,518   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,520   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,522   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,525   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,527   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,530   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,534   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,536   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,539   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,542   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,544   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-02-20T16:03:36,547   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-02-20T16:03:36,550   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-02-20T16:03:36,553   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-02-20T16:03:36,554   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,557   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,559   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,562   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,565   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,567   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,570   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,572   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,575   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,578   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-02-20T16:03:36,581   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-02-20T16:03:36,583   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-02-20T16:03:36,586   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-02-20T16:03:36,588   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-02-20T16:03:36,591   running install_egg_info
2025-02-20T16:03:36,638   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.4-py3.11.egg-info
2025-02-20T16:03:36,658   running install_scripts
2025-02-20T16:03:36,659   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,661   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,664   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,666   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,668   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,671   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,673   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,675   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,677   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,680   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,682   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts
2025-02-20T16:03:36,685   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/ds_report to 755
2025-02-20T16:03:36,686   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/ds to 755
2025-02-20T16:03:36,686   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/ds_ssh to 755
2025-02-20T16:03:36,687   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/dsr to 755
2025-02-20T16:03:36,688   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/deepspeed.pt to 755
2025-02-20T16:03:36,688   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/deepspeed to 755
2025-02-20T16:03:36,689   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/ds_bench to 755
2025-02-20T16:03:36,689   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/ds_nvme_tune to 755
2025-02-20T16:03:36,690   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/ds_io to 755
2025-02-20T16:03:36,690   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.data/scripts/ds_elastic to 755
2025-02-20T16:03:36,740   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.4.dist-info/WHEEL
2025-02-20T16:03:36,743   creating '/tmp/pip-wheel-it42njwn/deepspeed-0.16.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-02-20T16:03:36,747   adding 'deepspeed/__init__.py'
2025-02-20T16:03:36,748   adding 'deepspeed/constants.py'
2025-02-20T16:03:36,750   adding 'deepspeed/env_report.py'
2025-02-20T16:03:36,752   adding 'deepspeed/git_version_info.py'
2025-02-20T16:03:36,753   adding 'deepspeed/git_version_info_installed.py'
2025-02-20T16:03:36,755   adding 'deepspeed/accelerator/__init__.py'
2025-02-20T16:03:36,757   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-02-20T16:03:36,759   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-02-20T16:03:36,761   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-02-20T16:03:36,763   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-02-20T16:03:36,765   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-02-20T16:03:36,767   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-02-20T16:03:36,768   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-02-20T16:03:36,770   adding 'deepspeed/accelerator/real_accelerator.py'
2025-02-20T16:03:36,772   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-02-20T16:03:36,774   adding 'deepspeed/autotuning/__init__.py'
2025-02-20T16:03:36,779   adding 'deepspeed/autotuning/autotuner.py'
2025-02-20T16:03:36,781   adding 'deepspeed/autotuning/config.py'
2025-02-20T16:03:36,783   adding 'deepspeed/autotuning/constants.py'
2025-02-20T16:03:36,785   adding 'deepspeed/autotuning/scheduler.py'
2025-02-20T16:03:36,788   adding 'deepspeed/autotuning/utils.py'
2025-02-20T16:03:36,791   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-02-20T16:03:36,792   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-02-20T16:03:36,793   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-02-20T16:03:36,795   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-02-20T16:03:36,797   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-02-20T16:03:36,799   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-02-20T16:03:36,800   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-02-20T16:03:36,802   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-02-20T16:03:36,803   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-02-20T16:03:36,805   adding 'deepspeed/autotuning/tuner/utils.py'
2025-02-20T16:03:36,807   adding 'deepspeed/checkpoint/__init__.py'
2025-02-20T16:03:36,808   adding 'deepspeed/checkpoint/constants.py'
2025-02-20T16:03:36,811   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-02-20T16:03:36,813   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-02-20T16:03:36,815   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-02-20T16:03:36,817   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-02-20T16:03:36,818   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-02-20T16:03:36,820   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-02-20T16:03:36,821   adding 'deepspeed/checkpoint/utils.py'
2025-02-20T16:03:36,823   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-02-20T16:03:36,825   adding 'deepspeed/comm/__init__.py'
2025-02-20T16:03:36,826   adding 'deepspeed/comm/backend.py'
2025-02-20T16:03:36,828   adding 'deepspeed/comm/ccl.py'
2025-02-20T16:03:36,831   adding 'deepspeed/comm/comm.py'
2025-02-20T16:03:36,832   adding 'deepspeed/comm/config.py'
2025-02-20T16:03:36,834   adding 'deepspeed/comm/constants.py'
2025-02-20T16:03:36,835   adding 'deepspeed/comm/reduce_op.py'
2025-02-20T16:03:36,838   adding 'deepspeed/comm/torch.py'
2025-02-20T16:03:36,839   adding 'deepspeed/comm/utils.py'
2025-02-20T16:03:36,841   adding 'deepspeed/compression/__init__.py'
2025-02-20T16:03:36,844   adding 'deepspeed/compression/basic_layer.py'
2025-02-20T16:03:36,846   adding 'deepspeed/compression/compress.py'
2025-02-20T16:03:36,848   adding 'deepspeed/compression/config.py'
2025-02-20T16:03:36,850   adding 'deepspeed/compression/constants.py'
2025-02-20T16:03:36,852   adding 'deepspeed/compression/helper.py'
2025-02-20T16:03:36,854   adding 'deepspeed/compression/scheduler.py'
2025-02-20T16:03:36,855   adding 'deepspeed/compression/utils.py'
2025-02-20T16:03:36,858   adding 'deepspeed/elasticity/__init__.py'
2025-02-20T16:03:36,859   adding 'deepspeed/elasticity/config.py'
2025-02-20T16:03:36,860   adding 'deepspeed/elasticity/constants.py'
2025-02-20T16:03:36,862   adding 'deepspeed/elasticity/elastic_agent.py'
2025-02-20T16:03:36,865   adding 'deepspeed/elasticity/elasticity.py'
2025-02-20T16:03:36,866   adding 'deepspeed/elasticity/utils.py'
2025-02-20T16:03:36,868   adding 'deepspeed/inference/__init__.py'
2025-02-20T16:03:36,871   adding 'deepspeed/inference/config.py'
2025-02-20T16:03:36,875   adding 'deepspeed/inference/engine.py'
2025-02-20T16:03:36,877   adding 'deepspeed/inference/quantization/__init__.py'
2025-02-20T16:03:36,879   adding 'deepspeed/inference/quantization/layers.py'
2025-02-20T16:03:36,880   adding 'deepspeed/inference/quantization/quantization.py'
2025-02-20T16:03:36,882   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-02-20T16:03:36,884   adding 'deepspeed/inference/quantization/utils.py'
2025-02-20T16:03:36,887   adding 'deepspeed/inference/v2/__init__.py'
2025-02-20T16:03:36,888   adding 'deepspeed/inference/v2/allocator.py'
2025-02-20T16:03:36,889   adding 'deepspeed/inference/v2/config_v2.py'
2025-02-20T16:03:36,891   adding 'deepspeed/inference/v2/engine_factory.py'
2025-02-20T16:03:36,893   adding 'deepspeed/inference/v2/engine_v2.py'
2025-02-20T16:03:36,895   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-02-20T16:03:36,896   adding 'deepspeed/inference/v2/inference_utils.py'
2025-02-20T16:03:36,898   adding 'deepspeed/inference/v2/logging.py'
2025-02-20T16:03:36,899   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-02-20T16:03:36,901   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-02-20T16:03:36,902   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-02-20T16:03:36,905   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-02-20T16:03:36,906   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-02-20T16:03:36,908   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-02-20T16:03:36,910   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-02-20T16:03:36,912   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-02-20T16:03:36,914   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-02-20T16:03:36,916   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-02-20T16:03:36,917   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-02-20T16:03:36,919   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-02-20T16:03:36,920   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-02-20T16:03:36,921   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-02-20T16:03:36,923   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-02-20T16:03:36,924   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-02-20T16:03:36,925   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-02-20T16:03:36,927   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-02-20T16:03:36,929   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-02-20T16:03:36,930   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-02-20T16:03:36,931   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-02-20T16:03:36,932   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-02-20T16:03:36,934   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-02-20T16:03:36,935   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-02-20T16:03:36,936   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-02-20T16:03:36,939   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-02-20T16:03:36,941   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-02-20T16:03:36,943   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-02-20T16:03:36,944   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-02-20T16:03:36,946   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-02-20T16:03:36,948   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-02-20T16:03:36,950   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-02-20T16:03:36,952   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-02-20T16:03:36,955   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-02-20T16:03:36,956   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-02-20T16:03:36,958   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-02-20T16:03:36,960   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-02-20T16:03:36,962   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-02-20T16:03:36,963   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-02-20T16:03:36,965   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-02-20T16:03:36,967   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-02-20T16:03:36,969   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-02-20T16:03:36,971   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-02-20T16:03:36,972   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-02-20T16:03:36,974   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-02-20T16:03:36,975   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-02-20T16:03:36,977   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-02-20T16:03:36,979   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-02-20T16:03:36,981   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-02-20T16:03:36,982   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-02-20T16:03:36,984   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-02-20T16:03:36,986   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-02-20T16:03:36,987   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-02-20T16:03:36,989   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-02-20T16:03:36,991   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-02-20T16:03:36,993   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-02-20T16:03:36,994   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-02-20T16:03:36,996   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-02-20T16:03:36,998   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-02-20T16:03:36,999   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-02-20T16:03:37,001   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-02-20T16:03:37,003   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-02-20T16:03:37,004   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-02-20T16:03:37,006   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-02-20T16:03:37,008   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-02-20T16:03:37,009   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-02-20T16:03:37,011   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-02-20T16:03:37,013   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-02-20T16:03:37,015   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-02-20T16:03:37,017   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-02-20T16:03:37,019   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-02-20T16:03:37,022   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-02-20T16:03:37,024   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-02-20T16:03:37,026   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-02-20T16:03:37,028   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-02-20T16:03:37,029   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-02-20T16:03:37,031   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-02-20T16:03:37,032   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-02-20T16:03:37,035   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-02-20T16:03:37,036   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-02-20T16:03:37,038   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-02-20T16:03:37,039   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-02-20T16:03:37,041   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-02-20T16:03:37,042   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-02-20T16:03:37,045   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-02-20T16:03:37,046   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-02-20T16:03:37,048   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-02-20T16:03:37,050   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-02-20T16:03:37,051   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-02-20T16:03:37,053   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-02-20T16:03:37,055   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-02-20T16:03:37,057   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-02-20T16:03:37,059   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-02-20T16:03:37,060   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-02-20T16:03:37,062   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-02-20T16:03:37,063   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-02-20T16:03:37,066   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-02-20T16:03:37,067   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-02-20T16:03:37,069   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-02-20T16:03:37,071   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-02-20T16:03:37,072   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-02-20T16:03:37,074   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-02-20T16:03:37,075   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-02-20T16:03:37,077   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-02-20T16:03:37,079   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-02-20T16:03:37,081   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-02-20T16:03:37,082   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-02-20T16:03:37,083   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-02-20T16:03:37,085   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-02-20T16:03:37,087   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-02-20T16:03:37,088   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-02-20T16:03:37,090   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-02-20T16:03:37,092   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-02-20T16:03:37,094   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-02-20T16:03:37,095   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-02-20T16:03:37,096   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-02-20T16:03:37,098   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-02-20T16:03:37,100   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-02-20T16:03:37,102   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-02-20T16:03:37,103   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-02-20T16:03:37,106   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-02-20T16:03:37,107   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-02-20T16:03:37,109   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-02-20T16:03:37,110   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-02-20T16:03:37,112   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-02-20T16:03:37,113   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-02-20T16:03:37,116   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-02-20T16:03:37,118   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-02-20T16:03:37,120   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-02-20T16:03:37,122   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-02-20T16:03:37,126   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-02-20T16:03:37,129   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-02-20T16:03:37,131   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-02-20T16:03:37,133   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-02-20T16:03:37,135   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-02-20T16:03:37,136   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-02-20T16:03:37,138   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-02-20T16:03:37,139   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-02-20T16:03:37,141   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-02-20T16:03:37,142   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-02-20T16:03:37,144   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-02-20T16:03:37,146   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-02-20T16:03:37,147   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-02-20T16:03:37,149   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-02-20T16:03:37,151   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-02-20T16:03:37,153   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-02-20T16:03:37,154   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-02-20T16:03:37,156   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-02-20T16:03:37,158   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-02-20T16:03:37,160   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-02-20T16:03:37,162   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-02-20T16:03:37,163   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-02-20T16:03:37,165   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-02-20T16:03:37,167   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-02-20T16:03:37,169   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-02-20T16:03:37,170   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-02-20T16:03:37,172   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-02-20T16:03:37,174   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-02-20T16:03:37,175   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-02-20T16:03:37,177   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-02-20T16:03:37,179   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-02-20T16:03:37,180   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-02-20T16:03:37,182   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-02-20T16:03:37,184   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-02-20T16:03:37,186   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-02-20T16:03:37,188   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-02-20T16:03:37,191   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-02-20T16:03:37,192   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-02-20T16:03:37,194   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-02-20T16:03:37,196   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-02-20T16:03:37,198   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-02-20T16:03:37,199   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-02-20T16:03:37,201   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-02-20T16:03:37,203   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-02-20T16:03:37,205   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-02-20T16:03:37,206   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-02-20T16:03:37,208   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-02-20T16:03:37,210   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-02-20T16:03:37,212   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-02-20T16:03:37,214   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-02-20T16:03:37,216   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-02-20T16:03:37,218   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-02-20T16:03:37,220   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-02-20T16:03:37,221   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-02-20T16:03:37,223   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-02-20T16:03:37,225   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-02-20T16:03:37,227   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-02-20T16:03:37,229   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-02-20T16:03:37,230   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-02-20T16:03:37,232   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-02-20T16:03:37,233   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-02-20T16:03:37,235   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-02-20T16:03:37,237   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-02-20T16:03:37,238   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-02-20T16:03:37,240   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-02-20T16:03:37,242   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-02-20T16:03:37,244   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-02-20T16:03:37,246   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-02-20T16:03:37,247   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-02-20T16:03:37,249   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-02-20T16:03:37,250   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-02-20T16:03:37,251   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-02-20T16:03:37,253   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-02-20T16:03:37,255   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-02-20T16:03:37,257   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-02-20T16:03:37,259   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-02-20T16:03:37,261   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-02-20T16:03:37,263   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-02-20T16:03:37,264   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-02-20T16:03:37,266   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-02-20T16:03:37,268   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-02-20T16:03:37,270   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-02-20T16:03:37,272   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-02-20T16:03:37,274   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-02-20T16:03:37,275   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-02-20T16:03:37,277   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-02-20T16:03:37,278   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-02-20T16:03:37,280   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-02-20T16:03:37,281   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-02-20T16:03:37,283   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-02-20T16:03:37,285   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-02-20T16:03:37,286   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-02-20T16:03:37,287   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-02-20T16:03:37,288   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-02-20T16:03:37,290   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-02-20T16:03:37,291   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-02-20T16:03:37,292   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-02-20T16:03:37,294   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-02-20T16:03:37,296   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-02-20T16:03:37,297   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-02-20T16:03:37,299   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-02-20T16:03:37,301   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-02-20T16:03:37,302   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-02-20T16:03:37,304   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-02-20T16:03:37,306   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-02-20T16:03:37,308   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-02-20T16:03:37,309   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-02-20T16:03:37,311   adding 'deepspeed/launcher/__init__.py'
2025-02-20T16:03:37,312   adding 'deepspeed/launcher/constants.py'
2025-02-20T16:03:37,315   adding 'deepspeed/launcher/launch.py'
2025-02-20T16:03:37,316   adding 'deepspeed/launcher/launcher_helper.py'
2025-02-20T16:03:37,318   adding 'deepspeed/launcher/multinode_runner.py'
2025-02-20T16:03:37,322   adding 'deepspeed/launcher/runner.py'
2025-02-20T16:03:37,324   adding 'deepspeed/linear/__init__.py'
2025-02-20T16:03:37,325   adding 'deepspeed/linear/config.py'
2025-02-20T16:03:37,327   adding 'deepspeed/linear/context_manager.py'
2025-02-20T16:03:37,328   adding 'deepspeed/linear/optimized_linear.py'
2025-02-20T16:03:37,330   adding 'deepspeed/linear/quantization.py'
2025-02-20T16:03:37,332   adding 'deepspeed/model_implementations/__init__.py'
2025-02-20T16:03:37,333   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-02-20T16:03:37,335   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-02-20T16:03:37,336   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-02-20T16:03:37,338   adding 'deepspeed/model_implementations/features/__init__.py'
2025-02-20T16:03:37,340   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-02-20T16:03:37,342   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-02-20T16:03:37,343   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-02-20T16:03:37,344   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-02-20T16:03:37,346   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-02-20T16:03:37,347   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-02-20T16:03:37,348   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-02-20T16:03:37,349   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-02-20T16:03:37,351   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-02-20T16:03:37,352   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-02-20T16:03:37,354   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-02-20T16:03:37,356   adding 'deepspeed/module_inject/__init__.py'
2025-02-20T16:03:37,359   adding 'deepspeed/module_inject/auto_tp.py'
2025-02-20T16:03:37,360   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-02-20T16:03:37,362   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-02-20T16:03:37,364   adding 'deepspeed/module_inject/inject.py'
2025-02-20T16:03:37,367   adding 'deepspeed/module_inject/layers.py'
2025-02-20T16:03:37,369   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-02-20T16:03:37,370   adding 'deepspeed/module_inject/module_quantize.py'
2025-02-20T16:03:37,372   adding 'deepspeed/module_inject/policy.py'
2025-02-20T16:03:37,375   adding 'deepspeed/module_inject/replace_module.py'
2025-02-20T16:03:37,377   adding 'deepspeed/module_inject/replace_policy.py'
2025-02-20T16:03:37,379   adding 'deepspeed/module_inject/tp_shard.py'
2025-02-20T16:03:37,380   adding 'deepspeed/module_inject/utils.py'
2025-02-20T16:03:37,383   adding 'deepspeed/module_inject/containers/__init__.py'
2025-02-20T16:03:37,386   adding 'deepspeed/module_inject/containers/base.py'
2025-02-20T16:03:37,388   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-02-20T16:03:37,390   adding 'deepspeed/module_inject/containers/bert.py'
2025-02-20T16:03:37,392   adding 'deepspeed/module_inject/containers/bloom.py'
2025-02-20T16:03:37,394   adding 'deepspeed/module_inject/containers/clip.py'
2025-02-20T16:03:37,395   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-02-20T16:03:37,398   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-02-20T16:03:37,400   adding 'deepspeed/module_inject/containers/gptj.py'
2025-02-20T16:03:37,402   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-02-20T16:03:37,405   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-02-20T16:03:37,407   adding 'deepspeed/module_inject/containers/internlm.py'
2025-02-20T16:03:37,409   adding 'deepspeed/module_inject/containers/llama.py'
2025-02-20T16:03:37,411   adding 'deepspeed/module_inject/containers/llama2.py'
2025-02-20T16:03:37,413   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-02-20T16:03:37,414   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-02-20T16:03:37,417   adding 'deepspeed/module_inject/containers/opt.py'
2025-02-20T16:03:37,418   adding 'deepspeed/module_inject/containers/unet.py'
2025-02-20T16:03:37,420   adding 'deepspeed/module_inject/containers/vae.py'
2025-02-20T16:03:37,422   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-02-20T16:03:37,425   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-02-20T16:03:37,427   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-02-20T16:03:37,429   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-02-20T16:03:37,430   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-02-20T16:03:37,432   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-02-20T16:03:37,435   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-02-20T16:03:37,437   adding 'deepspeed/moe/__init__.py'
2025-02-20T16:03:37,438   adding 'deepspeed/moe/experts.py'
2025-02-20T16:03:37,440   adding 'deepspeed/moe/layer.py'
2025-02-20T16:03:37,442   adding 'deepspeed/moe/mappings.py'
2025-02-20T16:03:37,446   adding 'deepspeed/moe/sharded_moe.py'
2025-02-20T16:03:37,449   adding 'deepspeed/moe/utils.py'
2025-02-20T16:03:37,451   adding 'deepspeed/monitor/__init__.py'
2025-02-20T16:03:37,452   adding 'deepspeed/monitor/comet.py'
2025-02-20T16:03:37,454   adding 'deepspeed/monitor/config.py'
2025-02-20T16:03:37,456   adding 'deepspeed/monitor/csv_monitor.py'
2025-02-20T16:03:37,458   adding 'deepspeed/monitor/monitor.py'
2025-02-20T16:03:37,459   adding 'deepspeed/monitor/tensorboard.py'
2025-02-20T16:03:37,461   adding 'deepspeed/monitor/utils.py'
2025-02-20T16:03:37,462   adding 'deepspeed/monitor/wandb.py'
2025-02-20T16:03:37,465   adding 'deepspeed/nebula/__init__.py'
2025-02-20T16:03:37,466   adding 'deepspeed/nebula/config.py'
2025-02-20T16:03:37,468   adding 'deepspeed/nebula/constants.py'
2025-02-20T16:03:37,470   adding 'deepspeed/nvme/__init__.py'
2025-02-20T16:03:37,472   adding 'deepspeed/nvme/ds_aio_args.py'
2025-02-20T16:03:37,474   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-02-20T16:03:37,476   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-02-20T16:03:37,478   adding 'deepspeed/nvme/ds_aio_job.py'
2025-02-20T16:03:37,479   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-02-20T16:03:37,480   adding 'deepspeed/nvme/perf_generate_param.py'
2025-02-20T16:03:37,482   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-02-20T16:03:37,483   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-02-20T16:03:37,485   adding 'deepspeed/nvme/test_ds_aio.py'
2025-02-20T16:03:37,486   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-02-20T16:03:37,487   adding 'deepspeed/nvme/validate_async_io.py'
2025-02-20T16:03:37,489   adding 'deepspeed/ops/__init__.py'
2025-02-20T16:03:37,490   adding 'deepspeed/ops/adagrad/__init__.py'
2025-02-20T16:03:37,492   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-02-20T16:03:37,493   adding 'deepspeed/ops/adam/__init__.py'
2025-02-20T16:03:37,495   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-02-20T16:03:37,497   adding 'deepspeed/ops/adam/fused_adam.py'
2025-02-20T16:03:37,498   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-02-20T16:03:37,500   adding 'deepspeed/ops/aio/__init__.py'
2025-02-20T16:03:37,502   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-02-20T16:03:37,504   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-02-20T16:03:37,506   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-02-20T16:03:37,507   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-02-20T16:03:37,509   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-02-20T16:03:37,510   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-02-20T16:03:37,513   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-02-20T16:03:37,515   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-02-20T16:03:37,516   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-02-20T16:03:37,517   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-02-20T16:03:37,519   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-02-20T16:03:37,520   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-02-20T16:03:37,522   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-02-20T16:03:37,524   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-02-20T16:03:37,525   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-02-20T16:03:37,526   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-02-20T16:03:37,527   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-02-20T16:03:37,529   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-02-20T16:03:37,530   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-02-20T16:03:37,531   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-02-20T16:03:37,533   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-02-20T16:03:37,534   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-02-20T16:03:37,535   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-02-20T16:03:37,536   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-02-20T16:03:37,537   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-02-20T16:03:37,538   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-02-20T16:03:37,540   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-02-20T16:03:37,541   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-02-20T16:03:37,542   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-02-20T16:03:37,544   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-02-20T16:03:37,547   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-02-20T16:03:37,549   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-02-20T16:03:37,552   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-02-20T16:03:37,553   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-02-20T16:03:37,555   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-02-20T16:03:37,556   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-02-20T16:03:37,559   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-02-20T16:03:37,560   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-02-20T16:03:37,562   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-02-20T16:03:37,564   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-02-20T16:03:37,572   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-02-20T16:03:37,577   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-02-20T16:03:37,579   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-02-20T16:03:37,582   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-02-20T16:03:37,584   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-02-20T16:03:37,586   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-02-20T16:03:37,588   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-02-20T16:03:37,590   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-02-20T16:03:37,593   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-02-20T16:03:37,595   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-02-20T16:03:37,597   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-02-20T16:03:37,599   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-02-20T16:03:37,607   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-02-20T16:03:37,610   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-02-20T16:03:37,612   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-02-20T16:03:37,616   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-02-20T16:03:37,619   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-02-20T16:03:37,623   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-02-20T16:03:37,625   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-02-20T16:03:37,627   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-02-20T16:03:37,629   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-02-20T16:03:37,630   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-02-20T16:03:37,632   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-02-20T16:03:37,634   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-02-20T16:03:37,636   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-02-20T16:03:37,637   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-02-20T16:03:37,639   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-02-20T16:03:37,641   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-02-20T16:03:37,642   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-02-20T16:03:37,643   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-02-20T16:03:37,644   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-02-20T16:03:37,646   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-02-20T16:03:37,648   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-02-20T16:03:37,649   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-02-20T16:03:37,650   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-02-20T16:03:37,651   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-02-20T16:03:37,653   adding 'deepspeed/ops/csrc/includes/context.h'
2025-02-20T16:03:37,655   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-02-20T16:03:37,656   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-02-20T16:03:37,657   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-02-20T16:03:37,659   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-02-20T16:03:37,660   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-02-20T16:03:37,662   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-02-20T16:03:37,664   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-02-20T16:03:37,665   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-02-20T16:03:37,667   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-02-20T16:03:37,668   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-02-20T16:03:37,670   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-02-20T16:03:37,671   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-02-20T16:03:37,673   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-02-20T16:03:37,674   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-02-20T16:03:37,677   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-02-20T16:03:37,679   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-02-20T16:03:37,680   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-02-20T16:03:37,682   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-02-20T16:03:37,683   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-02-20T16:03:37,686   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-02-20T16:03:37,688   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-02-20T16:03:37,689   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-02-20T16:03:37,690   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-02-20T16:03:37,692   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-02-20T16:03:37,694   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-02-20T16:03:37,696   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-02-20T16:03:37,698   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-02-20T16:03:37,700   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-02-20T16:03:37,701   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-02-20T16:03:37,702   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-02-20T16:03:37,704   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-02-20T16:03:37,706   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-02-20T16:03:37,709   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-02-20T16:03:37,711   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-02-20T16:03:37,713   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-02-20T16:03:37,714   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-02-20T16:03:37,716   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-02-20T16:03:37,718   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-02-20T16:03:37,720   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-02-20T16:03:37,722   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-02-20T16:03:37,723   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-02-20T16:03:37,725   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-02-20T16:03:37,727   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-02-20T16:03:37,729   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-02-20T16:03:37,730   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-02-20T16:03:37,732   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-02-20T16:03:37,734   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-02-20T16:03:37,736   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-02-20T16:03:37,740   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-02-20T16:03:37,742   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-02-20T16:03:37,744   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-02-20T16:03:37,748   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-02-20T16:03:37,751   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-02-20T16:03:37,753   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-02-20T16:03:37,756   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-02-20T16:03:37,758   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-02-20T16:03:37,761   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-02-20T16:03:37,763   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-02-20T16:03:37,764   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-02-20T16:03:37,770   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-02-20T16:03:37,772   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-02-20T16:03:37,774   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-02-20T16:03:37,776   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-02-20T16:03:37,779   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-02-20T16:03:37,782   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-02-20T16:03:37,783   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-02-20T16:03:37,785   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-02-20T16:03:37,787   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2025-02-20T16:03:37,789   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-02-20T16:03:37,791   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-02-20T16:03:37,792   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-02-20T16:03:37,794   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-02-20T16:03:37,796   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-02-20T16:03:37,798   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-02-20T16:03:37,800   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-02-20T16:03:37,801   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-02-20T16:03:37,803   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-02-20T16:03:37,804   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-02-20T16:03:37,807   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-02-20T16:03:37,808   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-02-20T16:03:37,810   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-02-20T16:03:37,811   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-02-20T16:03:37,812   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-02-20T16:03:37,814   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-02-20T16:03:37,815   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-02-20T16:03:37,817   adding 'deepspeed/ops/gds/__init__.py'
2025-02-20T16:03:37,818   adding 'deepspeed/ops/lamb/__init__.py'
2025-02-20T16:03:37,820   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-02-20T16:03:37,822   adding 'deepspeed/ops/lion/__init__.py'
2025-02-20T16:03:37,823   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-02-20T16:03:37,825   adding 'deepspeed/ops/lion/fused_lion.py'
2025-02-20T16:03:37,826   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-02-20T16:03:37,828   adding 'deepspeed/ops/op_builder/__init__.py'
2025-02-20T16:03:37,829   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-02-20T16:03:37,831   adding 'deepspeed/ops/op_builder/async_io.py'
2025-02-20T16:03:37,835   adding 'deepspeed/ops/op_builder/builder.py'
2025-02-20T16:03:37,836   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-02-20T16:03:37,837   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-02-20T16:03:37,838   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-02-20T16:03:37,840   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-02-20T16:03:37,841   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-02-20T16:03:37,842   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-02-20T16:03:37,843   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-02-20T16:03:37,845   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-02-20T16:03:37,846   adding 'deepspeed/ops/op_builder/gds.py'
2025-02-20T16:03:37,847   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-02-20T16:03:37,849   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-02-20T16:03:37,850   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-02-20T16:03:37,851   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-02-20T16:03:37,852   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-02-20T16:03:37,854   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-02-20T16:03:37,855   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-02-20T16:03:37,857   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-02-20T16:03:37,858   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-02-20T16:03:37,859   adding 'deepspeed/ops/op_builder/transformer.py'
2025-02-20T16:03:37,860   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-02-20T16:03:37,862   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-02-20T16:03:37,863   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-02-20T16:03:37,865   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-02-20T16:03:37,866   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-02-20T16:03:37,867   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-02-20T16:03:37,869   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-02-20T16:03:37,870   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-02-20T16:03:37,872   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-02-20T16:03:37,873   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-02-20T16:03:37,875   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-02-20T16:03:37,876   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2025-02-20T16:03:37,878   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-02-20T16:03:37,879   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-02-20T16:03:37,880   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-02-20T16:03:37,882   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-02-20T16:03:37,883   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-02-20T16:03:37,884   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-02-20T16:03:37,887   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-02-20T16:03:37,888   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-02-20T16:03:37,889   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-02-20T16:03:37,891   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-02-20T16:03:37,892   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-02-20T16:03:37,893   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-02-20T16:03:37,894   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-02-20T16:03:37,895   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-02-20T16:03:37,896   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-02-20T16:03:37,898   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-02-20T16:03:37,899   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-02-20T16:03:37,901   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-02-20T16:03:37,902   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-02-20T16:03:37,904   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-02-20T16:03:37,906   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-02-20T16:03:37,907   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-02-20T16:03:37,909   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-02-20T16:03:37,910   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-02-20T16:03:37,911   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-02-20T16:03:37,913   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-02-20T16:03:37,916   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-02-20T16:03:37,918   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-02-20T16:03:37,920   adding 'deepspeed/ops/quantizer/__init__.py'
2025-02-20T16:03:37,922   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-02-20T16:03:37,924   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-02-20T16:03:37,925   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-02-20T16:03:37,927   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-02-20T16:03:37,928   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-02-20T16:03:37,932   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-02-20T16:03:37,934   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-02-20T16:03:37,936   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-02-20T16:03:37,938   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-02-20T16:03:37,941   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-02-20T16:03:37,943   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-02-20T16:03:37,945   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-02-20T16:03:37,946   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-02-20T16:03:37,948   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-02-20T16:03:37,950   adding 'deepspeed/ops/transformer/__init__.py'
2025-02-20T16:03:37,952   adding 'deepspeed/ops/transformer/transformer.py'
2025-02-20T16:03:37,954   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-02-20T16:03:37,956   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-02-20T16:03:37,957   adding 'deepspeed/ops/transformer/inference/config.py'
2025-02-20T16:03:37,959   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-02-20T16:03:37,960   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-02-20T16:03:37,962   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-02-20T16:03:37,964   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-02-20T16:03:37,966   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-02-20T16:03:37,969   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-02-20T16:03:37,971   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-02-20T16:03:37,973   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-02-20T16:03:37,974   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-02-20T16:03:37,976   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-02-20T16:03:37,977   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-02-20T16:03:37,978   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-02-20T16:03:37,979   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-02-20T16:03:37,980   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-02-20T16:03:37,982   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-02-20T16:03:37,983   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-02-20T16:03:37,984   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-02-20T16:03:37,985   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-02-20T16:03:37,988   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-02-20T16:03:37,989   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-02-20T16:03:37,990   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-02-20T16:03:37,991   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-02-20T16:03:38,205   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-02-20T16:03:38,206   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-02-20T16:03:38,207   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-02-20T16:03:38,209   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-02-20T16:03:38,211   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-02-20T16:03:38,212   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-02-20T16:03:38,213   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-02-20T16:03:38,215   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-02-20T16:03:38,217   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-02-20T16:03:38,219   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-02-20T16:03:38,221   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-02-20T16:03:38,222   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-02-20T16:03:38,224   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-02-20T16:03:38,226   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-02-20T16:03:38,227   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-02-20T16:03:38,228   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-02-20T16:03:38,230   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-02-20T16:03:38,232   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-02-20T16:03:38,233   adding 'deepspeed/pipe/__init__.py'
2025-02-20T16:03:38,235   adding 'deepspeed/profiling/__init__.py'
2025-02-20T16:03:38,236   adding 'deepspeed/profiling/config.py'
2025-02-20T16:03:38,238   adding 'deepspeed/profiling/constants.py'
2025-02-20T16:03:38,240   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-02-20T16:03:38,246   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-02-20T16:03:38,249   adding 'deepspeed/runtime/__init__.py'
2025-02-20T16:03:38,250   adding 'deepspeed/runtime/base_optimizer.py'
2025-02-20T16:03:38,253   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-02-20T16:03:38,254   adding 'deepspeed/runtime/compiler.py'
2025-02-20T16:03:38,259   adding 'deepspeed/runtime/config.py'
2025-02-20T16:03:38,261   adding 'deepspeed/runtime/config_utils.py'
2025-02-20T16:03:38,263   adding 'deepspeed/runtime/constants.py'
2025-02-20T16:03:38,264   adding 'deepspeed/runtime/dataloader.py'
2025-02-20T16:03:38,266   adding 'deepspeed/runtime/eigenvalue.py'
2025-02-20T16:03:38,285   adding 'deepspeed/runtime/engine.py'
2025-02-20T16:03:38,289   adding 'deepspeed/runtime/hybrid_engine.py'
2025-02-20T16:03:38,293   adding 'deepspeed/runtime/lr_schedules.py'
2025-02-20T16:03:38,294   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-02-20T16:03:38,296   adding 'deepspeed/runtime/quantize.py'
2025-02-20T16:03:38,297   adding 'deepspeed/runtime/sparse_tensor.py'
2025-02-20T16:03:38,299   adding 'deepspeed/runtime/state_dict_factory.py'
2025-02-20T16:03:38,304   adding 'deepspeed/runtime/utils.py'
2025-02-20T16:03:38,306   adding 'deepspeed/runtime/weight_quantizer.py'
2025-02-20T16:03:38,308   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-02-20T16:03:38,313   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-02-20T16:03:38,315   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-02-20T16:03:38,316   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-02-20T16:03:38,317   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-02-20T16:03:38,319   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-02-20T16:03:38,320   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-02-20T16:03:38,322   adding 'deepspeed/runtime/comm/__init__.py'
2025-02-20T16:03:38,324   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-02-20T16:03:38,325   adding 'deepspeed/runtime/comm/compressed.py'
2025-02-20T16:03:38,326   adding 'deepspeed/runtime/comm/hccl.py'
2025-02-20T16:03:38,328   adding 'deepspeed/runtime/comm/mpi.py'
2025-02-20T16:03:38,330   adding 'deepspeed/runtime/comm/nccl.py'
2025-02-20T16:03:38,332   adding 'deepspeed/runtime/compression/__init__.py'
2025-02-20T16:03:38,333   adding 'deepspeed/runtime/compression/cupy.py'
2025-02-20T16:03:38,335   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-02-20T16:03:38,337   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-02-20T16:03:38,338   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-02-20T16:03:38,340   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-02-20T16:03:38,342   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-02-20T16:03:38,343   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-02-20T16:03:38,344   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-02-20T16:03:38,346   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-02-20T16:03:38,347   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-02-20T16:03:38,350   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-02-20T16:03:38,355   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-02-20T16:03:38,357   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-02-20T16:03:38,360   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-02-20T16:03:38,362   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-02-20T16:03:38,364   adding 'deepspeed/runtime/domino/__init__.py'
2025-02-20T16:03:38,367   adding 'deepspeed/runtime/domino/transformer.py'
2025-02-20T16:03:38,369   adding 'deepspeed/runtime/fp16/__init__.py'
2025-02-20T16:03:38,372   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-02-20T16:03:38,374   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-02-20T16:03:38,377   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-02-20T16:03:38,379   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-02-20T16:03:38,381   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-02-20T16:03:38,384   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-02-20T16:03:38,386   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-02-20T16:03:38,388   adding 'deepspeed/runtime/pipe/__init__.py'
2025-02-20T16:03:38,395   adding 'deepspeed/runtime/pipe/engine.py'
2025-02-20T16:03:38,399   adding 'deepspeed/runtime/pipe/module.py'
2025-02-20T16:03:38,401   adding 'deepspeed/runtime/pipe/p2p.py'
2025-02-20T16:03:38,403   adding 'deepspeed/runtime/pipe/schedule.py'
2025-02-20T16:03:38,406   adding 'deepspeed/runtime/pipe/topology.py'
2025-02-20T16:03:38,408   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-02-20T16:03:38,409   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-02-20T16:03:38,410   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-02-20T16:03:38,411   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-02-20T16:03:38,414   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-02-20T16:03:38,416   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-02-20T16:03:38,418   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-02-20T16:03:38,420   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-02-20T16:03:38,422   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-02-20T16:03:38,424   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2025-02-20T16:03:38,426   adding 'deepspeed/runtime/tensor_parallel/config.py'
2025-02-20T16:03:38,427   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2025-02-20T16:03:38,429   adding 'deepspeed/runtime/zero/__init__.py'
2025-02-20T16:03:38,432   adding 'deepspeed/runtime/zero/config.py'
2025-02-20T16:03:38,434   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-02-20T16:03:38,435   adding 'deepspeed/runtime/zero/linear.py'
2025-02-20T16:03:38,438   adding 'deepspeed/runtime/zero/mics.py'
2025-02-20T16:03:38,440   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-02-20T16:03:38,441   adding 'deepspeed/runtime/zero/offload_config.py'
2025-02-20T16:03:38,442   adding 'deepspeed/runtime/zero/offload_states.py'
2025-02-20T16:03:38,445   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-02-20T16:03:38,457   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-02-20T16:03:38,461   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-02-20T16:03:38,463   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-02-20T16:03:38,478   adding 'deepspeed/runtime/zero/stage3.py'
2025-02-20T16:03:38,493   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-02-20T16:03:38,495   adding 'deepspeed/runtime/zero/test.py'
2025-02-20T16:03:38,497   adding 'deepspeed/runtime/zero/tiling.py'
2025-02-20T16:03:38,498   adding 'deepspeed/runtime/zero/utils.py'
2025-02-20T16:03:38,500   adding 'deepspeed/sequence/__init__.py'
2025-02-20T16:03:38,502   adding 'deepspeed/sequence/cross_entropy.py'
2025-02-20T16:03:38,506   adding 'deepspeed/sequence/fpdt_layer.py'
2025-02-20T16:03:38,509   adding 'deepspeed/sequence/layer.py'
2025-02-20T16:03:38,511   adding 'deepspeed/utils/__init__.py'
2025-02-20T16:03:38,513   adding 'deepspeed/utils/bwc.py'
2025-02-20T16:03:38,514   adding 'deepspeed/utils/comms_logging.py'
2025-02-20T16:03:38,516   adding 'deepspeed/utils/config.py'
2025-02-20T16:03:38,517   adding 'deepspeed/utils/debug.py'
2025-02-20T16:03:38,519   adding 'deepspeed/utils/exceptions.py'
2025-02-20T16:03:38,522   adding 'deepspeed/utils/groups.py'
2025-02-20T16:03:38,523   adding 'deepspeed/utils/init_on_device.py'
2025-02-20T16:03:38,525   adding 'deepspeed/utils/logging.py'
2025-02-20T16:03:38,526   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-02-20T16:03:38,528   adding 'deepspeed/utils/numa.py'
2025-02-20T16:03:38,529   adding 'deepspeed/utils/nvtx.py'
2025-02-20T16:03:38,531   adding 'deepspeed/utils/tensor_fragment.py'
2025-02-20T16:03:38,533   adding 'deepspeed/utils/timer.py'
2025-02-20T16:03:38,535   adding 'deepspeed/utils/torch.py'
2025-02-20T16:03:38,536   adding 'deepspeed/utils/types.py'
2025-02-20T16:03:38,538   adding 'deepspeed/utils/z3_leaf_module.py'
2025-02-20T16:03:38,542   adding 'deepspeed/utils/zero_to_fp32.py'
2025-02-20T16:03:38,544   adding 'deepspeed-0.16.4.data/scripts/deepspeed'
2025-02-20T16:03:38,545   adding 'deepspeed-0.16.4.data/scripts/deepspeed.pt'
2025-02-20T16:03:38,546   adding 'deepspeed-0.16.4.data/scripts/ds'
2025-02-20T16:03:38,548   adding 'deepspeed-0.16.4.data/scripts/ds_bench'
2025-02-20T16:03:38,549   adding 'deepspeed-0.16.4.data/scripts/ds_elastic'
2025-02-20T16:03:38,550   adding 'deepspeed-0.16.4.data/scripts/ds_io'
2025-02-20T16:03:38,551   adding 'deepspeed-0.16.4.data/scripts/ds_nvme_tune'
2025-02-20T16:03:38,552   adding 'deepspeed-0.16.4.data/scripts/ds_report'
2025-02-20T16:03:38,554   adding 'deepspeed-0.16.4.data/scripts/ds_ssh'
2025-02-20T16:03:38,555   adding 'deepspeed-0.16.4.data/scripts/dsr'
2025-02-20T16:03:38,558   adding 'deepspeed-0.16.4.dist-info/LICENSE'
2025-02-20T16:03:38,563   adding 'deepspeed-0.16.4.dist-info/METADATA'
2025-02-20T16:03:38,564   adding 'deepspeed-0.16.4.dist-info/WHEEL'
2025-02-20T16:03:38,565   adding 'deepspeed-0.16.4.dist-info/entry_points.txt'
2025-02-20T16:03:38,566   adding 'deepspeed-0.16.4.dist-info/top_level.txt'
2025-02-20T16:03:38,580   adding 'deepspeed-0.16.4.dist-info/RECORD'
2025-02-20T16:03:38,609   removing build/bdist.linux-armv7l/wheel
2025-02-20T16:03:38,894   deepspeed build time = 12.46022653579712 secs
2025-02-20T16:03:39,022   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-02-20T16:03:39,040   Created wheel for deepspeed: filename=deepspeed-0.16.4-py3-none-any.whl size=1562527 sha256=f7e7f46731a9413aa0993e9ee9416b6a9855dffe584e16f0bbd4194a018748b2
2025-02-20T16:03:39,041   Stored in directory: /tmp/pip-ephem-wheel-cache-21mjkuam/wheels/b3/6c/e5/ccad75c8ade9cb21e74721affd6d17820b1806249aac34f7f0
2025-02-20T16:03:39,086 Successfully built deepspeed
2025-02-20T16:03:39,126 Removed build tracker: '/tmp/pip-build-tracker-hii_pn0q'