2024-11-08T17:37:47,947 Created temporary directory: /tmp/pip-build-tracker-arpwu239
2024-11-08T17:37:47,948 Initialized build tracking at /tmp/pip-build-tracker-arpwu239
2024-11-08T17:37:47,949 Created build tracker: /tmp/pip-build-tracker-arpwu239
2024-11-08T17:37:47,949 Entered build tracker: /tmp/pip-build-tracker-arpwu239
2024-11-08T17:37:47,950 Created temporary directory: /tmp/pip-wheel-iz9anujx
2024-11-08T17:37:47,954 Created temporary directory: /tmp/pip-ephem-wheel-cache-9suhymio
2024-11-08T17:37:47,998 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-11-08T17:37:48,000 2 location(s) to search for versions of deepspeed:
2024-11-08T17:37:48,000 * https://pypi.org/simple/deepspeed/
2024-11-08T17:37:48,000 * https://www.piwheels.org/simple/deepspeed/
2024-11-08T17:37:48,001 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-11-08T17:37:48,002 Getting page https://pypi.org/simple/deepspeed/
2024-11-08T17:37:48,003 Found index url https://pypi.org/simple/
2024-11-08T17:37:48,151 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-11-08T17:37:48,170   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-08T17:37:48,171   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-11-08T17:37:48,171   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-08T17:37:48,172   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-11-08T17:37:48,173   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-08T17:37:48,173   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-11-08T17:37:48,174   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-08T17:37:48,175   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-11-08T17:37:48,176   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-08T17:37:48,176   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-11-08T17:37:48,177   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-11-08T17:37:48,178   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-11-08T17:37:48,179   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-11-08T17:37:48,179   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-11-08T17:37:48,180   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-11-08T17:37:48,180   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-11-08T17:37:48,181   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-11-08T17:37:48,182   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-11-08T17:37:48,182   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-11-08T17:37:48,183   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-11-08T17:37:48,183   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-11-08T17:37:48,184   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-11-08T17:37:48,185   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-11-08T17:37:48,186   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-11-08T17:37:48,186   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-11-08T17:37:48,187   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-11-08T17:37:48,188   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-11-08T17:37:48,189   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-11-08T17:37:48,189   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-11-08T17:37:48,190   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-11-08T17:37:48,191   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-11-08T17:37:48,192   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-11-08T17:37:48,192   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-11-08T17:37:48,193   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-11-08T17:37:48,193   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-11-08T17:37:48,194   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-11-08T17:37:48,195   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-11-08T17:37:48,195   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-11-08T17:37:48,196   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-11-08T17:37:48,196   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-11-08T17:37:48,197   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-11-08T17:37:48,198   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-11-08T17:37:48,199   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-11-08T17:37:48,199   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-11-08T17:37:48,200   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-11-08T17:37:48,201   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-11-08T17:37:48,202   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-11-08T17:37:48,202   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-11-08T17:37:48,203   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-11-08T17:37:48,204   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-11-08T17:37:48,205   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-11-08T17:37:48,206   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-11-08T17:37:48,206   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-11-08T17:37:48,207   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-11-08T17:37:48,207   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-11-08T17:37:48,208   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-11-08T17:37:48,208   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-11-08T17:37:48,209   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-11-08T17:37:48,210   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-11-08T17:37:48,211   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-11-08T17:37:48,211   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-11-08T17:37:48,212   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-11-08T17:37:48,213   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-11-08T17:37:48,213   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-11-08T17:37:48,214   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-11-08T17:37:48,215   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-11-08T17:37:48,216   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-11-08T17:37:48,216   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-11-08T17:37:48,217   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-11-08T17:37:48,218   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-11-08T17:37:48,218   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-11-08T17:37:48,219   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-11-08T17:37:48,220   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-11-08T17:37:48,220   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-11-08T17:37:48,221   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-11-08T17:37:48,221   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-11-08T17:37:48,222   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-11-08T17:37:48,223   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-11-08T17:37:48,224   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-11-08T17:37:48,224   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-11-08T17:37:48,225   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-11-08T17:37:48,226   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-11-08T17:37:48,226   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-11-08T17:37:48,227   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-11-08T17:37:48,228   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-11-08T17:37:48,229   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-11-08T17:37:48,230   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-11-08T17:37:48,230   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-11-08T17:37:48,231   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-11-08T17:37:48,231   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-11-08T17:37:48,232   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-11-08T17:37:48,232   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-11-08T17:37:48,233   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-11-08T17:37:48,234   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-11-08T17:37:48,234   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-11-08T17:37:48,235   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-11-08T17:37:48,236   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-11-08T17:37:48,236   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-11-08T17:37:48,237   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-11-08T17:37:48,238   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2024-11-08T17:37:48,238   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2024-11-08T17:37:48,239   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2024-11-08T17:37:48,240   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2024-11-08T17:37:48,240   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2024-11-08T17:37:48,241 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-11-08T17:37:48,242 Getting page https://www.piwheels.org/simple/deepspeed/
2024-11-08T17:37:48,243 Found index url https://www.piwheels.org/simple/
2024-11-08T17:37:48,418 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-11-08T17:37:48,437   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,437   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,438   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,438   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,439   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,439   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,440   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,441   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,441   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,442   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,443   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,443   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,444   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,445   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,446   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,446   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,447   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,447   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,448   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,448   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,449   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,449   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,450   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,451   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,451   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,452   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,453   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,453   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,454   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,455   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,455   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,456   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,456   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,457   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,457   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,458   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,459   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,459   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,460   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,461   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,461   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,462   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,463   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,464   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,464   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,464   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,465   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,465   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,466   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,466   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,467   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,467   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,468   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,468   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,469   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,469   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,470   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,470   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,471   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,472   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,472   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,473   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,473   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,474   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,474   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,475   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,475   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,476   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,476   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,477   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,477   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-08T17:37:48,478 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-11-08T17:37:48,478 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-11-08T17:37:48,510 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-11-08T17:37:48,513 Collecting deepspeed==0.15.4
2024-11-08T17:37:48,515   Created temporary directory: /tmp/pip-unpack-w__gdiej
2024-11-08T17:37:48,655   Downloading deepspeed-0.15.4.tar.gz (1.4 MB)
2024-11-08T17:37:51,110   Added deepspeed==0.15.4 from https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz to build tracker '/tmp/pip-build-tracker-arpwu239'
2024-11-08T17:37:51,113   Running setup.py (path:/tmp/pip-wheel-iz9anujx/deepspeed_6a59ad9b2aa04c80910ab0c95095327b/setup.py) egg_info for package deepspeed
2024-11-08T17:37:51,114   Created temporary directory: /tmp/pip-pip-egg-info-rwe7thwq
2024-11-08T17:37:51,114   Preparing metadata (setup.py): started
2024-11-08T17:37:51,116   Running command python setup.py egg_info
2024-11-08T17:37:52,771   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-11-08T17:37:52,771    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-11-08T17:37:52,772   DS_BUILD_OPS=0
2024-11-08T17:37:52,773   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-11-08T17:37:52,773   version=0.15.4, git_hash=unknown, git_branch=unknown
2024-11-08T17:37:52,774   install_requires=['hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-11-08T17:37:52,775   ext_modules=[]
2024-11-08T17:37:52,775   running egg_info
2024-11-08T17:37:52,800   creating /tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info
2024-11-08T17:37:52,802   writing /tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info/PKG-INFO
2024-11-08T17:37:52,835   writing dependency_links to /tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info/dependency_links.txt
2024-11-08T17:37:52,837   writing entry points to /tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info/entry_points.txt
2024-11-08T17:37:52,855   writing requirements to /tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info/requires.txt
2024-11-08T17:37:52,856   writing top-level names to /tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info/top_level.txt
2024-11-08T17:37:52,858   writing manifest file '/tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info/SOURCES.txt'
2024-11-08T17:37:53,099   reading manifest file '/tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info/SOURCES.txt'
2024-11-08T17:37:53,100   reading manifest template 'MANIFEST.in'
2024-11-08T17:37:53,102   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-11-08T17:37:53,103   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-11-08T17:37:54,687   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-11-08T17:37:55,634   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-11-08T17:37:56,260   warning: no files found matching '*.tr' under directory 'csrc'
2024-11-08T17:37:56,376   warning: no files found matching '*.cc' under directory 'csrc'
2024-11-08T17:37:56,426   warning: no files found matching '*.py' under directory 'benchmarks'
2024-11-08T17:37:56,431   adding license file 'LICENSE'
2024-11-08T17:37:56,470   writing manifest file '/tmp/pip-pip-egg-info-rwe7thwq/deepspeed.egg-info/SOURCES.txt'
2024-11-08T17:37:56,472   deepspeed build time = 4.370809316635132 secs
2024-11-08T17:37:56,587   Preparing metadata (setup.py): finished with status 'done'
2024-11-08T17:37:56,593   Source in /tmp/pip-wheel-iz9anujx/deepspeed_6a59ad9b2aa04c80910ab0c95095327b has version 0.15.4, which satisfies requirement deepspeed==0.15.4 from https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz
2024-11-08T17:37:56,595   Removed deepspeed==0.15.4 from https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz from build tracker '/tmp/pip-build-tracker-arpwu239'
2024-11-08T17:37:56,666 Created temporary directory: /tmp/pip-unpack-7tc0f0mn
2024-11-08T17:37:56,667 Created temporary directory: /tmp/pip-unpack-wkxyyib1
2024-11-08T17:37:56,668 Building wheels for collected packages: deepspeed
2024-11-08T17:37:56,671   Created temporary directory: /tmp/pip-wheel-a4yvs4v7
2024-11-08T17:37:56,672   Building wheel for deepspeed (setup.py): started
2024-11-08T17:37:56,673   Destination directory: /tmp/pip-wheel-a4yvs4v7
2024-11-08T17:37:56,674   Running command python setup.py bdist_wheel
2024-11-08T17:37:57,170   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-11-08T17:37:57,175    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-11-08T17:37:57,271   DS_BUILD_OPS=0
2024-11-08T17:37:57,390   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-11-08T17:37:57,411   version=0.15.4, git_hash=unknown, git_branch=unknown
2024-11-08T17:37:57,411   install_requires=['hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-11-08T17:37:57,412   ext_modules=[]
2024-11-08T17:37:58,019   running bdist_wheel
2024-11-08T17:37:58,154   running build
2024-11-08T17:37:58,154   running build_py
2024-11-08T17:37:58,184   creating build/lib/deepspeed
2024-11-08T17:37:58,186   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-11-08T17:37:58,189   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-11-08T17:37:58,191   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-11-08T17:37:58,193   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-11-08T17:37:58,195   copying deepspeed/constants.py -> build/lib/deepspeed
2024-11-08T17:37:58,198   creating build/lib/deepspeed/module_inject
2024-11-08T17:37:58,199   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,201   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,203   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,206   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,208   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,210   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,213   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,215   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,218   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,221   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,223   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,225   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,228   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-11-08T17:37:58,231   creating build/lib/deepspeed/ops
2024-11-08T17:37:58,232   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-11-08T17:37:58,235   creating build/lib/deepspeed/pipe
2024-11-08T17:37:58,236   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-11-08T17:37:58,239   creating build/lib/deepspeed/inference
2024-11-08T17:37:58,240   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-11-08T17:37:58,242   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-11-08T17:37:58,246   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-11-08T17:37:58,249   creating build/lib/deepspeed/moe
2024-11-08T17:37:58,251   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-11-08T17:37:58,254   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-11-08T17:37:58,256   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-11-08T17:37:58,258   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-11-08T17:37:58,261   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-11-08T17:37:58,264   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-11-08T17:37:58,267   creating build/lib/deepspeed/autotuning
2024-11-08T17:37:58,268   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-11-08T17:37:58,272   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-11-08T17:37:58,274   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-11-08T17:37:58,277   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-11-08T17:37:58,280   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-11-08T17:37:58,283   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-11-08T17:37:58,286   creating build/lib/deepspeed/monitor
2024-11-08T17:37:58,288   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-11-08T17:37:58,290   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-11-08T17:37:58,292   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-11-08T17:37:58,295   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-11-08T17:37:58,297   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-11-08T17:37:58,299   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-11-08T17:37:58,301   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-11-08T17:37:58,304   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-11-08T17:37:58,307   creating build/lib/deepspeed/accelerator
2024-11-08T17:37:58,308   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,311   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,314   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,316   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,319   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,322   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,324   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,327   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,330   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,333   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-08T17:37:58,343   creating build/lib/deepspeed/utils
2024-11-08T17:37:58,345   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,347   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,349   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,353   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,355   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,357   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,360   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,362   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,365   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,368   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,370   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,372   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,375   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,378   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,380   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,382   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,384   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,385   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-11-08T17:37:58,388   creating build/lib/deepspeed/launcher
2024-11-08T17:37:58,390   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-11-08T17:37:58,391   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-11-08T17:37:58,394   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-11-08T17:37:58,397   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-11-08T17:37:58,399   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-11-08T17:37:58,401   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-11-08T17:37:58,404   creating build/lib/deepspeed/compression
2024-11-08T17:37:58,405   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-11-08T17:37:58,408   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-11-08T17:37:58,409   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-11-08T17:37:58,412   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-11-08T17:37:58,415   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-11-08T17:37:58,417   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-11-08T17:37:58,420   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-11-08T17:37:58,422   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-11-08T17:37:58,425   creating build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,426   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,429   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,431   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,433   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,435   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,438   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,440   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,442   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,445   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,447   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-11-08T17:37:58,449   creating build/lib/deepspeed/nvme
2024-11-08T17:37:58,450   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,452   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,454   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,456   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,458   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,460   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,462   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,464   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,466   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,468   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,470   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,471   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2024-11-08T17:37:58,474   creating build/lib/deepspeed/comm
2024-11-08T17:37:58,476   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,477   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,480   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,482   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,484   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,486   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,489   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,491   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,492   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-11-08T17:37:58,495   creating build/lib/deepspeed/model_implementations
2024-11-08T17:37:58,496   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-11-08T17:37:58,498   creating build/lib/deepspeed/elasticity
2024-11-08T17:37:58,499   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-11-08T17:37:58,501   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-11-08T17:37:58,504   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-11-08T17:37:58,506   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-11-08T17:37:58,508   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-11-08T17:37:58,510   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-11-08T17:37:58,513   creating build/lib/deepspeed/profiling
2024-11-08T17:37:58,514   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-11-08T17:37:58,516   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-11-08T17:37:58,518   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-11-08T17:37:58,520   creating build/lib/deepspeed/linear
2024-11-08T17:37:58,521   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-11-08T17:37:58,523   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-11-08T17:37:58,525   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-11-08T17:37:58,527   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-11-08T17:37:58,529   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-11-08T17:37:58,532   creating build/lib/deepspeed/runtime
2024-11-08T17:37:58,533   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,536   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,539   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,541   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,544   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,546   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,548   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,551   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,556   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,558   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,560   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,562   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,565   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,567   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,569   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,571   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,574   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,577   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-11-08T17:37:58,580   creating build/lib/deepspeed/sequence
2024-11-08T17:37:58,581   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-11-08T17:37:58,584   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-11-08T17:37:58,586   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2024-11-08T17:37:58,589   creating build/lib/deepspeed/nebula
2024-11-08T17:37:58,590   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-11-08T17:37:58,592   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-11-08T17:37:58,594   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-11-08T17:37:58,597   creating build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,598   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,600   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,602   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,604   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,607   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,609   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,611   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,613   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,616   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,617   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,620   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,622   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,625   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,628   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,630   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,633   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,636   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,638   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,641   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-11-08T17:37:58,645   creating build/lib/deepspeed/module_inject/containers/features
2024-11-08T17:37:58,646   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-08T17:37:58,650   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-08T17:37:58,653   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-08T17:37:58,655   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-08T17:37:58,658   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-08T17:37:58,660   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-08T17:37:58,663   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-08T17:37:58,666   creating build/lib/deepspeed/ops/lamb
2024-11-08T17:37:58,668   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-11-08T17:37:58,670   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-11-08T17:37:58,674   creating build/lib/deepspeed/ops/adagrad
2024-11-08T17:37:58,675   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-11-08T17:37:58,678   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-11-08T17:37:58,682   creating build/lib/deepspeed/ops/aio
2024-11-08T17:37:58,683   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-11-08T17:37:58,687   creating build/lib/deepspeed/ops/adam
2024-11-08T17:37:58,688   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-11-08T17:37:58,691   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-11-08T17:37:58,694   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-11-08T17:37:58,697   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-11-08T17:37:58,700   creating build/lib/deepspeed/ops/quantizer
2024-11-08T17:37:58,701   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-11-08T17:37:58,704   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-11-08T17:37:58,707   creating build/lib/deepspeed/ops/random_ltd
2024-11-08T17:37:58,708   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-11-08T17:37:58,711   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-11-08T17:37:58,714   creating build/lib/deepspeed/ops/transformer
2024-11-08T17:37:58,716   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-11-08T17:37:58,719   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-11-08T17:37:58,722   creating build/lib/deepspeed/ops/lion
2024-11-08T17:37:58,723   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-11-08T17:37:58,725   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-11-08T17:37:58,727   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-11-08T17:37:58,729   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-11-08T17:37:58,732   creating build/lib/deepspeed/ops/deepspeed4science
2024-11-08T17:37:58,733   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-11-08T17:37:58,735   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-11-08T17:37:58,738   creating build/lib/deepspeed/ops/sparse_attention
2024-11-08T17:37:58,739   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-08T17:37:58,742   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-08T17:37:58,744   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-08T17:37:58,746   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-08T17:37:58,748   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-08T17:37:58,751   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-08T17:37:58,754   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-08T17:37:58,757   creating build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,758   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,760   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,762   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,765   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,767   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,769   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,771   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,773   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,775   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,777   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,779   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,781   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,783   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,785   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,787   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,789   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,791   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,793   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,796   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,798   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,800   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,802   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,805   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,807   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-11-08T17:37:58,809   creating build/lib/deepspeed/ops/fp_quantizer
2024-11-08T17:37:58,810   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-11-08T17:37:58,813   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-11-08T17:37:58,815   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-11-08T17:37:58,818   creating build/lib/deepspeed/ops/gds
2024-11-08T17:37:58,819   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2024-11-08T17:37:58,822   creating build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,823   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,825   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,827   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,829   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,832   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,834   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,837   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,839   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,841   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,844   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-08T17:37:58,847   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,849   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,851   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,853   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,855   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,857   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,860   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,862   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,864   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,866   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,868   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,870   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,872   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,874   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,876   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,879   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,880   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,882   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,884   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,886   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,888   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,890   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,892   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,894   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:37:58,897   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,898   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,901   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,903   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,905   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,908   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,910   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,912   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,914   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,916   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,918   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-08T17:37:58,921   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:37:58,922   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:37:58,925   creating build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,926   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,928   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,930   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,932   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,934   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,935   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,937   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,940   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,941   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,943   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-08T17:37:58,946   creating build/lib/deepspeed/ops/op_builder/cpu
2024-11-08T17:37:58,947   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-08T17:37:58,949   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-08T17:37:58,951   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-08T17:37:58,953   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-08T17:37:58,954   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-08T17:37:58,956   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-08T17:37:58,958   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-08T17:37:58,961   creating build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,962   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,964   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,966   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,968   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,970   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,972   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,975   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,976   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,978   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-08T17:37:58,981   creating build/lib/deepspeed/ops/op_builder/hpu
2024-11-08T17:37:58,982   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-08T17:37:58,984   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-08T17:37:58,986   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-08T17:37:58,988   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-08T17:37:58,990   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-08T17:37:58,992   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-08T17:37:58,995   creating build/lib/deepspeed/ops/op_builder/mlu
2024-11-08T17:37:58,996   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-08T17:37:58,998   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-08T17:37:59,000   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-08T17:37:59,002   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-08T17:37:59,004   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-08T17:37:59,006   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-08T17:37:59,009   creating build/lib/deepspeed/inference/quantization
2024-11-08T17:37:59,010   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-11-08T17:37:59,012   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-11-08T17:37:59,014   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-11-08T17:37:59,016   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-11-08T17:37:59,019   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-11-08T17:37:59,022   creating build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,023   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,025   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,027   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,029   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,031   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,034   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,036   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,038   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,040   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-11-08T17:37:59,043   creating build/lib/deepspeed/inference/v2/modules
2024-11-08T17:37:59,044   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-11-08T17:37:59,046   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-11-08T17:37:59,048   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-11-08T17:37:59,050   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-11-08T17:37:59,053   creating build/lib/deepspeed/inference/v2/checkpoint
2024-11-08T17:37:59,054   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-11-08T17:37:59,056   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-11-08T17:37:59,058   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-11-08T17:37:59,061   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-11-08T17:37:59,063   creating build/lib/deepspeed/inference/v2/kernels
2024-11-08T17:37:59,064   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-11-08T17:37:59,066   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-11-08T17:37:59,069   creating build/lib/deepspeed/inference/v2/model_implementations
2024-11-08T17:37:59,070   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-08T17:37:59,072   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-08T17:37:59,075   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-08T17:37:59,077   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-08T17:37:59,080   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-08T17:37:59,082   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-08T17:37:59,085   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-08T17:37:59,088   creating build/lib/deepspeed/inference/v2/ragged
2024-11-08T17:37:59,089   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-08T17:37:59,091   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-08T17:37:59,094   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-08T17:37:59,096   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-08T17:37:59,098   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-08T17:37:59,101   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-08T17:37:59,104   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-08T17:37:59,106   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-11-08T17:37:59,108   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-11-08T17:37:59,110   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,112   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,114   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,116   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,118   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,120   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,122   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,125   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,127   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:37:59,130   creating build/lib/deepspeed/inference/v2/modules/configs
2024-11-08T17:37:59,132   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-08T17:37:59,134   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-08T17:37:59,136   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-08T17:37:59,138   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-08T17:37:59,140   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-08T17:37:59,142   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-08T17:37:59,144   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-08T17:37:59,147   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-11-08T17:37:59,148   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-11-08T17:37:59,150   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-11-08T17:37:59,153   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-11-08T17:37:59,155   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-11-08T17:37:59,157   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-11-08T17:37:59,159   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-11-08T17:37:59,160   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-11-08T17:37:59,163   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-11-08T17:37:59,166   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-11-08T17:37:59,167   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-11-08T17:37:59,170   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-11-08T17:37:59,173   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-08T17:37:59,175   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-08T17:37:59,177   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-08T17:37:59,179   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-08T17:37:59,182   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-11-08T17:37:59,183   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-11-08T17:37:59,185   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-11-08T17:37:59,188   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-11-08T17:37:59,190   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-11-08T17:37:59,192   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-11-08T17:37:59,195   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-11-08T17:37:59,197   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-11-08T17:37:59,198   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-11-08T17:37:59,201   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-11-08T17:37:59,202   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-11-08T17:37:59,205   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-11-08T17:37:59,207   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-11-08T17:37:59,210   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:37:59,211   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:37:59,214   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:37:59,218   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:37:59,219   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:37:59,222   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:37:59,225   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:37:59,227   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:37:59,230   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:37:59,231   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:37:59,233   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:37:59,235   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:37:59,237   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:37:59,239   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:37:59,242   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:37:59,244   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:37:59,246   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:37:59,248   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:37:59,250   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:37:59,252   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:37:59,255   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:37:59,256   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:37:59,259   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:37:59,261   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:37:59,263   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:37:59,265   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:37:59,268   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:37:59,270   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:37:59,272   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:37:59,274   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:37:59,276   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:37:59,279   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:37:59,280   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:37:59,283   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:37:59,286   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:37:59,287   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:37:59,289   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:37:59,292   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:37:59,293   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:37:59,295   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:37:59,298   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:37:59,299   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:37:59,301   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:37:59,303   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:37:59,304   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:37:59,306   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:37:59,309   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:37:59,310   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:37:59,312   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:37:59,315   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:37:59,316   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:37:59,318   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:37:59,320   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:37:59,323   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:37:59,324   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:37:59,326   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:37:59,329   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:37:59,330   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:37:59,332   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:37:59,335   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:37:59,336   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:37:59,339   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,340   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,342   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,344   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,346   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,348   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,350   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,352   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,354   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,356   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:37:59,359   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:37:59,360   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:37:59,363   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:37:59,365   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:37:59,367   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:37:59,370   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:37:59,371   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:37:59,374   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:37:59,376   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:37:59,378   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:37:59,380   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:37:59,381   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:37:59,384   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:37:59,386   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:37:59,388   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:37:59,390   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,392   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,394   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,397   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,399   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,401   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,403   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,405   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,407   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,409   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:37:59,412   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:37:59,414   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:37:59,416   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:37:59,418   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:37:59,420   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:37:59,423   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:37:59,424   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:37:59,427   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:37:59,429   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:37:59,432   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:37:59,435   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:37:59,437   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:37:59,439   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:37:59,442   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:37:59,444   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:37:59,447   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:37:59,449   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:37:59,452   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:37:59,455   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:37:59,457   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:37:59,460   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:37:59,462   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:37:59,465   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:37:59,467   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:37:59,470   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:37:59,473   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:37:59,475   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:37:59,478   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:37:59,480   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:37:59,483   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:37:59,486   creating build/lib/deepspeed/autotuning/tuner
2024-11-08T17:37:59,488   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-11-08T17:37:59,490   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-11-08T17:37:59,493   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-11-08T17:37:59,496   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-11-08T17:37:59,499   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-11-08T17:37:59,502   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-11-08T17:37:59,505   creating build/lib/deepspeed/model_implementations/features
2024-11-08T17:37:59,506   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-11-08T17:37:59,509   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-11-08T17:37:59,512   creating build/lib/deepspeed/model_implementations/diffusers
2024-11-08T17:37:59,513   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-11-08T17:37:59,516   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-11-08T17:37:59,519   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-11-08T17:37:59,522   creating build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,524   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,526   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,529   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,531   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,532   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,535   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,537   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,539   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,541   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,543   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-08T17:37:59,546   creating build/lib/deepspeed/profiling/flops_profiler
2024-11-08T17:37:59,547   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-11-08T17:37:59,549   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-11-08T17:37:59,552   creating build/lib/deepspeed/runtime/fp16
2024-11-08T17:37:59,554   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-11-08T17:37:59,556   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-11-08T17:37:59,558   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-11-08T17:37:59,561   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-11-08T17:37:59,564   creating build/lib/deepspeed/runtime/pipe
2024-11-08T17:37:59,566   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-11-08T17:37:59,568   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-11-08T17:37:59,570   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-11-08T17:37:59,574   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-11-08T17:37:59,577   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-11-08T17:37:59,580   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-11-08T17:37:59,583   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-11-08T17:37:59,585   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-11-08T17:37:59,588   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-11-08T17:37:59,590   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-11-08T17:37:59,593   creating build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,594   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,597   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,599   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,602   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,604   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,606   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,608   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,611   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,613   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-08T17:37:59,616   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-11-08T17:37:59,617   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-11-08T17:37:59,619   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-11-08T17:37:59,622   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-11-08T17:37:59,624   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-11-08T17:37:59,626   creating build/lib/deepspeed/runtime/compression
2024-11-08T17:37:59,628   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-11-08T17:37:59,630   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-11-08T17:37:59,632   creating build/lib/deepspeed/runtime/data_pipeline
2024-11-08T17:37:59,634   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-11-08T17:37:59,636   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-11-08T17:37:59,638   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-11-08T17:37:59,641   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-11-08T17:37:59,644   creating build/lib/deepspeed/runtime/comm
2024-11-08T17:37:59,645   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-11-08T17:37:59,647   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-11-08T17:37:59,650   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-11-08T17:37:59,652   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-11-08T17:37:59,655   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-11-08T17:37:59,657   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-11-08T17:37:59,660   creating build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,662   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,664   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,670   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,672   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,677   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,680   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,682   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,683   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,686   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,688   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,691   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,693   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,698   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,700   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,703   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,706   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,708   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2024-11-08T17:37:59,710   creating build/lib/deepspeed/runtime/fp16/onebit
2024-11-08T17:37:59,711   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-11-08T17:37:59,714   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-11-08T17:37:59,717   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-11-08T17:37:59,719   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-11-08T17:37:59,723   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:37:59,724   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:37:59,726   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:37:59,729   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:37:59,731   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:37:59,734   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:37:59,736   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:37:59,738   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:37:59,740   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:37:59,743   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:37:59,747   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:37:59,750   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:37:59,753   running egg_info
2024-11-08T17:37:59,783   writing deepspeed.egg-info/PKG-INFO
2024-11-08T17:37:59,816   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-11-08T17:37:59,818   writing entry points to deepspeed.egg-info/entry_points.txt
2024-11-08T17:37:59,835   writing requirements to deepspeed.egg-info/requires.txt
2024-11-08T17:37:59,836   writing top-level names to deepspeed.egg-info/top_level.txt
2024-11-08T17:37:59,970   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-11-08T17:38:00,061   reading manifest template 'MANIFEST.in'
2024-11-08T17:38:00,063   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-11-08T17:38:00,063   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-11-08T17:38:01,638   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-11-08T17:38:02,641   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-11-08T17:38:03,288   warning: no files found matching '*.tr' under directory 'csrc'
2024-11-08T17:38:03,411   warning: no files found matching '*.cc' under directory 'csrc'
2024-11-08T17:38:03,454   warning: no files found matching '*.py' under directory 'benchmarks'
2024-11-08T17:38:03,460   adding license file 'LICENSE'
2024-11-08T17:38:03,536   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-11-08T17:38:03,548   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-11-08T17:38:03,548   !!

2024-11-08T17:38:03,549           ********************************************************************************
2024-11-08T17:38:03,550           ############################
2024-11-08T17:38:03,550           # Package would be ignored #
2024-11-08T17:38:03,551           ############################
2024-11-08T17:38:03,552           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-11-08T17:38:03,552           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,554           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,554           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-11-08T17:38:03,555           to the `packages` configuration field.

2024-11-08T17:38:03,556           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,557           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,558           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,559           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,560           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,561           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-11-08T17:38:03,562           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-11-08T17:38:03,562           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,563           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,564           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,565           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,566           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,568           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,568                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,569                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,569                 directory, all directories are treated like packages.
2024-11-08T17:38:03,570           ********************************************************************************

2024-11-08T17:38:03,571   !!
2024-11-08T17:38:03,572     check.warn(importable)
2024-11-08T17:38:03,572   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-11-08T17:38:03,573   !!

2024-11-08T17:38:03,574           ********************************************************************************
2024-11-08T17:38:03,574           ############################
2024-11-08T17:38:03,574           # Package would be ignored #
2024-11-08T17:38:03,575           ############################
2024-11-08T17:38:03,575           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-11-08T17:38:03,576           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,576           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,577           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-11-08T17:38:03,577           to the `packages` configuration field.

2024-11-08T17:38:03,578           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,578           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,579           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,579           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,580           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,581           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-11-08T17:38:03,581           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-11-08T17:38:03,582           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,582           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,583           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,584           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,585           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,587           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,587                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,588                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,589                 directory, all directories are treated like packages.
2024-11-08T17:38:03,589           ********************************************************************************

2024-11-08T17:38:03,590   !!
2024-11-08T17:38:03,590     check.warn(importable)
2024-11-08T17:38:03,591   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-11-08T17:38:03,591   !!

2024-11-08T17:38:03,592           ********************************************************************************
2024-11-08T17:38:03,593           ############################
2024-11-08T17:38:03,593           # Package would be ignored #
2024-11-08T17:38:03,594           ############################
2024-11-08T17:38:03,594           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-11-08T17:38:03,595           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,596           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,596           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-11-08T17:38:03,597           to the `packages` configuration field.

2024-11-08T17:38:03,598           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,598           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,598           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,599           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,600           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,600           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-11-08T17:38:03,601           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-11-08T17:38:03,601           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,601           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,602           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,602           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,603           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,604           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,605                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,605                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,605                 directory, all directories are treated like packages.
2024-11-08T17:38:03,606           ********************************************************************************

2024-11-08T17:38:03,607   !!
2024-11-08T17:38:03,607     check.warn(importable)
2024-11-08T17:38:03,608   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-11-08T17:38:03,609   !!

2024-11-08T17:38:03,610           ********************************************************************************
2024-11-08T17:38:03,610           ############################
2024-11-08T17:38:03,611           # Package would be ignored #
2024-11-08T17:38:03,611           ############################
2024-11-08T17:38:03,612           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-11-08T17:38:03,612           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,613           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,614           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-11-08T17:38:03,614           to the `packages` configuration field.

2024-11-08T17:38:03,615           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,616           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,616           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,617           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,618           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,619           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-11-08T17:38:03,620           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-11-08T17:38:03,620           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,621           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,621           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,622           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,623           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,624           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,624                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,625                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,625                 directory, all directories are treated like packages.
2024-11-08T17:38:03,625           ********************************************************************************

2024-11-08T17:38:03,626   !!
2024-11-08T17:38:03,626     check.warn(importable)
2024-11-08T17:38:03,627   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-11-08T17:38:03,627   !!

2024-11-08T17:38:03,628           ********************************************************************************
2024-11-08T17:38:03,628           ############################
2024-11-08T17:38:03,629           # Package would be ignored #
2024-11-08T17:38:03,629           ############################
2024-11-08T17:38:03,629           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-11-08T17:38:03,630           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,630           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,631           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-11-08T17:38:03,631           to the `packages` configuration field.

2024-11-08T17:38:03,632           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,633           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,633           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,634           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,635           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,637           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-11-08T17:38:03,637           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-11-08T17:38:03,638           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,638           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,641           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,642           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,643           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,644           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,645                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,645                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,646                 directory, all directories are treated like packages.
2024-11-08T17:38:03,646           ********************************************************************************

2024-11-08T17:38:03,647   !!
2024-11-08T17:38:03,648     check.warn(importable)
2024-11-08T17:38:03,648   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-11-08T17:38:03,649   !!

2024-11-08T17:38:03,650           ********************************************************************************
2024-11-08T17:38:03,650           ############################
2024-11-08T17:38:03,651           # Package would be ignored #
2024-11-08T17:38:03,651           ############################
2024-11-08T17:38:03,651           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-11-08T17:38:03,651           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,652           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,653           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-11-08T17:38:03,653           to the `packages` configuration field.

2024-11-08T17:38:03,654           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,654           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,655           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,655           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,656           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,657           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-11-08T17:38:03,657           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-11-08T17:38:03,657           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,658           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,658           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,659           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,661           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,662           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,663                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,663                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,664                 directory, all directories are treated like packages.
2024-11-08T17:38:03,665           ********************************************************************************

2024-11-08T17:38:03,665   !!
2024-11-08T17:38:03,666     check.warn(importable)
2024-11-08T17:38:03,666   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-11-08T17:38:03,667   !!

2024-11-08T17:38:03,668           ********************************************************************************
2024-11-08T17:38:03,668           ############################
2024-11-08T17:38:03,669           # Package would be ignored #
2024-11-08T17:38:03,669           ############################
2024-11-08T17:38:03,670           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-11-08T17:38:03,670           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,671           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,672           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-11-08T17:38:03,672           to the `packages` configuration field.

2024-11-08T17:38:03,673           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,674           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,675           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,676           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,677           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,677           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-11-08T17:38:03,678           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-11-08T17:38:03,678           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,678           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,679           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,679           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,680           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,682           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,682                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,682                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,683                 directory, all directories are treated like packages.
2024-11-08T17:38:03,683           ********************************************************************************

2024-11-08T17:38:03,684   !!
2024-11-08T17:38:03,684     check.warn(importable)
2024-11-08T17:38:03,684   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-11-08T17:38:03,685   !!

2024-11-08T17:38:03,686           ********************************************************************************
2024-11-08T17:38:03,686           ############################
2024-11-08T17:38:03,687           # Package would be ignored #
2024-11-08T17:38:03,687           ############################
2024-11-08T17:38:03,688           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-11-08T17:38:03,688           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,689           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,690           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-11-08T17:38:03,690           to the `packages` configuration field.

2024-11-08T17:38:03,691           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,692           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,692           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,693           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,694           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,695           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-11-08T17:38:03,696           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-11-08T17:38:03,696           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,697           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,698           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,914           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,916           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,917           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,918                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,919                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,919                 directory, all directories are treated like packages.
2024-11-08T17:38:03,919           ********************************************************************************

2024-11-08T17:38:03,920   !!
2024-11-08T17:38:03,920     check.warn(importable)
2024-11-08T17:38:03,921   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-11-08T17:38:03,921   !!

2024-11-08T17:38:03,922           ********************************************************************************
2024-11-08T17:38:03,922           ############################
2024-11-08T17:38:03,922           # Package would be ignored #
2024-11-08T17:38:03,923           ############################
2024-11-08T17:38:03,923           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-11-08T17:38:03,923           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,924           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,925           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-11-08T17:38:03,925           to the `packages` configuration field.

2024-11-08T17:38:03,926           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,926           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,927           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,927           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,930           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,931           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-11-08T17:38:03,932           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-11-08T17:38:03,932           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,933           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,934           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,935           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,936           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,938           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,938                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,938                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,939                 directory, all directories are treated like packages.
2024-11-08T17:38:03,939           ********************************************************************************

2024-11-08T17:38:03,940   !!
2024-11-08T17:38:03,941     check.warn(importable)
2024-11-08T17:38:03,941   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-11-08T17:38:03,942   !!

2024-11-08T17:38:03,943           ********************************************************************************
2024-11-08T17:38:03,943           ############################
2024-11-08T17:38:03,944           # Package would be ignored #
2024-11-08T17:38:03,944           ############################
2024-11-08T17:38:03,945           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-11-08T17:38:03,945           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,947           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,947           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-11-08T17:38:03,947           to the `packages` configuration field.

2024-11-08T17:38:03,948           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,948           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,949           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,949           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,950           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,951           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-11-08T17:38:03,951           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-11-08T17:38:03,952           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,952           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,952           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,953           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,954           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,955           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,955                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,956                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,956                 directory, all directories are treated like packages.
2024-11-08T17:38:03,957           ********************************************************************************

2024-11-08T17:38:03,957   !!
2024-11-08T17:38:03,958     check.warn(importable)
2024-11-08T17:38:03,958   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-11-08T17:38:03,959   !!

2024-11-08T17:38:03,960           ********************************************************************************
2024-11-08T17:38:03,961           ############################
2024-11-08T17:38:03,961           # Package would be ignored #
2024-11-08T17:38:03,961           ############################
2024-11-08T17:38:03,962           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-11-08T17:38:03,962           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,963           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,964           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-11-08T17:38:03,964           to the `packages` configuration field.

2024-11-08T17:38:03,965           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,966           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,966           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,967           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,968           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,969           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-11-08T17:38:03,970           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-11-08T17:38:03,970           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,971           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,971           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,973           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,974           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,975           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,975                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,976                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,976                 directory, all directories are treated like packages.
2024-11-08T17:38:03,977           ********************************************************************************

2024-11-08T17:38:03,977   !!
2024-11-08T17:38:03,978     check.warn(importable)
2024-11-08T17:38:03,978   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-11-08T17:38:03,978   !!

2024-11-08T17:38:03,979           ********************************************************************************
2024-11-08T17:38:03,979           ############################
2024-11-08T17:38:03,980           # Package would be ignored #
2024-11-08T17:38:03,980           ############################
2024-11-08T17:38:03,981           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-11-08T17:38:03,981           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:03,982           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:03,982           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-11-08T17:38:03,983           to the `packages` configuration field.

2024-11-08T17:38:03,984           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:03,984           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:03,985           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:03,986           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:03,987           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:03,988           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-11-08T17:38:03,988           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-11-08T17:38:03,989           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:03,989           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:03,990           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:03,991           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:03,991           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:03,993           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:03,993                 even if it does not contain any `.py` files.
2024-11-08T17:38:03,994                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:03,994                 directory, all directories are treated like packages.
2024-11-08T17:38:03,995           ********************************************************************************

2024-11-08T17:38:03,996   !!
2024-11-08T17:38:03,996     check.warn(importable)
2024-11-08T17:38:03,997   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-11-08T17:38:03,997   !!

2024-11-08T17:38:03,998           ********************************************************************************
2024-11-08T17:38:03,999           ############################
2024-11-08T17:38:04,000           # Package would be ignored #
2024-11-08T17:38:04,000           ############################
2024-11-08T17:38:04,000           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-11-08T17:38:04,001           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,001           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,002           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-11-08T17:38:04,002           to the `packages` configuration field.

2024-11-08T17:38:04,003           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,003           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,003           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,004           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,005           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,006           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-11-08T17:38:04,006           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-11-08T17:38:04,007           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,007           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,007           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,008           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,009           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,011           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,011                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,012                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,013                 directory, all directories are treated like packages.
2024-11-08T17:38:04,013           ********************************************************************************

2024-11-08T17:38:04,014   !!
2024-11-08T17:38:04,015     check.warn(importable)
2024-11-08T17:38:04,015   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-11-08T17:38:04,016   !!

2024-11-08T17:38:04,017           ********************************************************************************
2024-11-08T17:38:04,017           ############################
2024-11-08T17:38:04,018           # Package would be ignored #
2024-11-08T17:38:04,018           ############################
2024-11-08T17:38:04,018           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-11-08T17:38:04,019           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,020           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,020           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-11-08T17:38:04,021           to the `packages` configuration field.

2024-11-08T17:38:04,022           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,022           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,023           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,024           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,025           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,026           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-11-08T17:38:04,027           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-11-08T17:38:04,027           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,027           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,028           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,029           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,029           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,030           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,031                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,031                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,031                 directory, all directories are treated like packages.
2024-11-08T17:38:04,032           ********************************************************************************

2024-11-08T17:38:04,033   !!
2024-11-08T17:38:04,033     check.warn(importable)
2024-11-08T17:38:04,033   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-11-08T17:38:04,034   !!

2024-11-08T17:38:04,034           ********************************************************************************
2024-11-08T17:38:04,035           ############################
2024-11-08T17:38:04,035           # Package would be ignored #
2024-11-08T17:38:04,036           ############################
2024-11-08T17:38:04,037           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-11-08T17:38:04,037           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,038           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,039           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-11-08T17:38:04,039           to the `packages` configuration field.

2024-11-08T17:38:04,040           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,041           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,041           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,042           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,043           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,044           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-11-08T17:38:04,045           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-11-08T17:38:04,045           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,046           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,046           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,047           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,048           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,049           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,050                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,050                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,051                 directory, all directories are treated like packages.
2024-11-08T17:38:04,051           ********************************************************************************

2024-11-08T17:38:04,053   !!
2024-11-08T17:38:04,053     check.warn(importable)
2024-11-08T17:38:04,054   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-11-08T17:38:04,054   !!

2024-11-08T17:38:04,055           ********************************************************************************
2024-11-08T17:38:04,055           ############################
2024-11-08T17:38:04,055           # Package would be ignored #
2024-11-08T17:38:04,056           ############################
2024-11-08T17:38:04,056           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-11-08T17:38:04,057           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,057           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,058           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-11-08T17:38:04,058           to the `packages` configuration field.

2024-11-08T17:38:04,059           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,059           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,059           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,060           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,061           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,061           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-11-08T17:38:04,062           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-11-08T17:38:04,062           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,063           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,064           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,065           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,066           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,067           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,068                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,068                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,069                 directory, all directories are treated like packages.
2024-11-08T17:38:04,069           ********************************************************************************

2024-11-08T17:38:04,070   !!
2024-11-08T17:38:04,071     check.warn(importable)
2024-11-08T17:38:04,071   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-11-08T17:38:04,071   !!

2024-11-08T17:38:04,072           ********************************************************************************
2024-11-08T17:38:04,073           ############################
2024-11-08T17:38:04,073           # Package would be ignored #
2024-11-08T17:38:04,074           ############################
2024-11-08T17:38:04,074           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-11-08T17:38:04,075           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,076           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,076           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-11-08T17:38:04,077           to the `packages` configuration field.

2024-11-08T17:38:04,078           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,079           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,079           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,080           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,080           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,081           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-11-08T17:38:04,081           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-11-08T17:38:04,082           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,082           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,082           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,083           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,084           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,085           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,085                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,086                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,086                 directory, all directories are treated like packages.
2024-11-08T17:38:04,086           ********************************************************************************

2024-11-08T17:38:04,087   !!
2024-11-08T17:38:04,088     check.warn(importable)
2024-11-08T17:38:04,088   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-11-08T17:38:04,089   !!

2024-11-08T17:38:04,090           ********************************************************************************
2024-11-08T17:38:04,090           ############################
2024-11-08T17:38:04,091           # Package would be ignored #
2024-11-08T17:38:04,091           ############################
2024-11-08T17:38:04,091           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-11-08T17:38:04,092           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,093           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,094           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-11-08T17:38:04,094           to the `packages` configuration field.

2024-11-08T17:38:04,095           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,096           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,096           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,097           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,098           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,099           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-11-08T17:38:04,100           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-11-08T17:38:04,100           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,101           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,101           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,102           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,103           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,104           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,104                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,105                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,105                 directory, all directories are treated like packages.
2024-11-08T17:38:04,105           ********************************************************************************

2024-11-08T17:38:04,106   !!
2024-11-08T17:38:04,106     check.warn(importable)
2024-11-08T17:38:04,107   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-11-08T17:38:04,107   !!

2024-11-08T17:38:04,108           ********************************************************************************
2024-11-08T17:38:04,108           ############################
2024-11-08T17:38:04,108           # Package would be ignored #
2024-11-08T17:38:04,109           ############################
2024-11-08T17:38:04,109           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-11-08T17:38:04,109           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,110           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,111           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-11-08T17:38:04,111           to the `packages` configuration field.

2024-11-08T17:38:04,112           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,113           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,113           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,114           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,115           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,116           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-11-08T17:38:04,117           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-11-08T17:38:04,117           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,118           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,118           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,119           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,120           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,121           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,122                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,122                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,123                 directory, all directories are treated like packages.
2024-11-08T17:38:04,123           ********************************************************************************

2024-11-08T17:38:04,124   !!
2024-11-08T17:38:04,125     check.warn(importable)
2024-11-08T17:38:04,125   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-11-08T17:38:04,126   !!

2024-11-08T17:38:04,127           ********************************************************************************
2024-11-08T17:38:04,127           ############################
2024-11-08T17:38:04,127           # Package would be ignored #
2024-11-08T17:38:04,128           ############################
2024-11-08T17:38:04,128           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-11-08T17:38:04,128           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,129           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,129           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-11-08T17:38:04,130           to the `packages` configuration field.

2024-11-08T17:38:04,130           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,131           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,131           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,132           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,133           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,133           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-11-08T17:38:04,134           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-11-08T17:38:04,134           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,134           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,135           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,136           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,137           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,138           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,139                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,140                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,140                 directory, all directories are treated like packages.
2024-11-08T17:38:04,141           ********************************************************************************

2024-11-08T17:38:04,142   !!
2024-11-08T17:38:04,143     check.warn(importable)
2024-11-08T17:38:04,143   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-11-08T17:38:04,144   !!

2024-11-08T17:38:04,145           ********************************************************************************
2024-11-08T17:38:04,145           ############################
2024-11-08T17:38:04,145           # Package would be ignored #
2024-11-08T17:38:04,146           ############################
2024-11-08T17:38:04,146           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-11-08T17:38:04,147           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,148           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,148           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-11-08T17:38:04,149           to the `packages` configuration field.

2024-11-08T17:38:04,150           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,150           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,151           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,152           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,153           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,153           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-11-08T17:38:04,154           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-11-08T17:38:04,154           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,154           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,155           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,156           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,156           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,157           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,158                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,158                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,158                 directory, all directories are treated like packages.
2024-11-08T17:38:04,159           ********************************************************************************

2024-11-08T17:38:04,160   !!
2024-11-08T17:38:04,160     check.warn(importable)
2024-11-08T17:38:04,161   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-11-08T17:38:04,161   !!

2024-11-08T17:38:04,162           ********************************************************************************
2024-11-08T17:38:04,162           ############################
2024-11-08T17:38:04,163           # Package would be ignored #
2024-11-08T17:38:04,164           ############################
2024-11-08T17:38:04,164           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-11-08T17:38:04,165           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,166           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,166           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-11-08T17:38:04,167           to the `packages` configuration field.

2024-11-08T17:38:04,168           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,168           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,169           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,169           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,170           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,171           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-11-08T17:38:04,172           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-11-08T17:38:04,172           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,173           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,173           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,174           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,175           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,177           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,178                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,178                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,179                 directory, all directories are treated like packages.
2024-11-08T17:38:04,179           ********************************************************************************

2024-11-08T17:38:04,180   !!
2024-11-08T17:38:04,180     check.warn(importable)
2024-11-08T17:38:04,180   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-11-08T17:38:04,181   !!

2024-11-08T17:38:04,181           ********************************************************************************
2024-11-08T17:38:04,182           ############################
2024-11-08T17:38:04,182           # Package would be ignored #
2024-11-08T17:38:04,182           ############################
2024-11-08T17:38:04,183           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-11-08T17:38:04,183           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,184           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,184           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-11-08T17:38:04,185           to the `packages` configuration field.

2024-11-08T17:38:04,185           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,186           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,186           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,187           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,188           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,189           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-11-08T17:38:04,190           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-11-08T17:38:04,190           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,190           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,191           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,192           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,193           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,194           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,195                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,195                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,196                 directory, all directories are treated like packages.
2024-11-08T17:38:04,196           ********************************************************************************

2024-11-08T17:38:04,197   !!
2024-11-08T17:38:04,198     check.warn(importable)
2024-11-08T17:38:04,198   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2024-11-08T17:38:04,199   !!

2024-11-08T17:38:04,200           ********************************************************************************
2024-11-08T17:38:04,200           ############################
2024-11-08T17:38:04,201           # Package would be ignored #
2024-11-08T17:38:04,201           ############################
2024-11-08T17:38:04,202           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2024-11-08T17:38:04,202           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,204           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,204           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2024-11-08T17:38:04,204           to the `packages` configuration field.

2024-11-08T17:38:04,205           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,205           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,206           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,206           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,207           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,208           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2024-11-08T17:38:04,208           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2024-11-08T17:38:04,208           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,209           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,209           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,210           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,211           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,212           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,213                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,213                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,214                 directory, all directories are treated like packages.
2024-11-08T17:38:04,214           ********************************************************************************

2024-11-08T17:38:04,216   !!
2024-11-08T17:38:04,216     check.warn(importable)
2024-11-08T17:38:04,217   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-11-08T17:38:04,217   !!

2024-11-08T17:38:04,218           ********************************************************************************
2024-11-08T17:38:04,219           ############################
2024-11-08T17:38:04,220           # Package would be ignored #
2024-11-08T17:38:04,220           ############################
2024-11-08T17:38:04,221           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-11-08T17:38:04,221           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,222           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,223           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-11-08T17:38:04,223           to the `packages` configuration field.

2024-11-08T17:38:04,224           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,225           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,226           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,227           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,228           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,229           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-11-08T17:38:04,230           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-11-08T17:38:04,230           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,231           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,231           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,232           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,233           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,234           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,235                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,235                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,235                 directory, all directories are treated like packages.
2024-11-08T17:38:04,236           ********************************************************************************

2024-11-08T17:38:04,237   !!
2024-11-08T17:38:04,237     check.warn(importable)
2024-11-08T17:38:04,238   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-11-08T17:38:04,238   !!

2024-11-08T17:38:04,239           ********************************************************************************
2024-11-08T17:38:04,239           ############################
2024-11-08T17:38:04,240           # Package would be ignored #
2024-11-08T17:38:04,240           ############################
2024-11-08T17:38:04,241           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-11-08T17:38:04,241           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,242           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,243           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-11-08T17:38:04,243           to the `packages` configuration field.

2024-11-08T17:38:04,244           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,245           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,245           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,246           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,247           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,248           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-11-08T17:38:04,249           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-11-08T17:38:04,249           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,250           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,250           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,251           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,253           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,255           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,255                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,256                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,256                 directory, all directories are treated like packages.
2024-11-08T17:38:04,257           ********************************************************************************

2024-11-08T17:38:04,258   !!
2024-11-08T17:38:04,258     check.warn(importable)
2024-11-08T17:38:04,259   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-11-08T17:38:04,259   !!

2024-11-08T17:38:04,261           ********************************************************************************
2024-11-08T17:38:04,262           ############################
2024-11-08T17:38:04,262           # Package would be ignored #
2024-11-08T17:38:04,263           ############################
2024-11-08T17:38:04,264           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-11-08T17:38:04,264           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,265           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,266           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-11-08T17:38:04,267           to the `packages` configuration field.

2024-11-08T17:38:04,268           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,270           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,271           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,272           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,274           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,275           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-11-08T17:38:04,276           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-11-08T17:38:04,276           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,277           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,278           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,279           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,280           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,283           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,283                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,284                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,285                 directory, all directories are treated like packages.
2024-11-08T17:38:04,286           ********************************************************************************

2024-11-08T17:38:04,287   !!
2024-11-08T17:38:04,288     check.warn(importable)
2024-11-08T17:38:04,289   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-11-08T17:38:04,290   !!

2024-11-08T17:38:04,291           ********************************************************************************
2024-11-08T17:38:04,292           ############################
2024-11-08T17:38:04,293           # Package would be ignored #
2024-11-08T17:38:04,294           ############################
2024-11-08T17:38:04,294           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-11-08T17:38:04,295           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,297           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,297           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-11-08T17:38:04,298           to the `packages` configuration field.

2024-11-08T17:38:04,300           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,300           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,301           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,303           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,305           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,306           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-11-08T17:38:04,307           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-11-08T17:38:04,307           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,308           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,309           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,310           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,312           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,314           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,314                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,315                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,315                 directory, all directories are treated like packages.
2024-11-08T17:38:04,316           ********************************************************************************

2024-11-08T17:38:04,317   !!
2024-11-08T17:38:04,318     check.warn(importable)
2024-11-08T17:38:04,319   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-11-08T17:38:04,319   !!

2024-11-08T17:38:04,321           ********************************************************************************
2024-11-08T17:38:04,322           ############################
2024-11-08T17:38:04,322           # Package would be ignored #
2024-11-08T17:38:04,323           ############################
2024-11-08T17:38:04,324           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-11-08T17:38:04,324           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,326           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,326           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-11-08T17:38:04,327           to the `packages` configuration field.

2024-11-08T17:38:04,328           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,329           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,330           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,331           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,333           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,334           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-11-08T17:38:04,335           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-11-08T17:38:04,336           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,336           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,337           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,339           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,340           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,342           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,343                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,344                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,344                 directory, all directories are treated like packages.
2024-11-08T17:38:04,345           ********************************************************************************

2024-11-08T17:38:04,347   !!
2024-11-08T17:38:04,347     check.warn(importable)
2024-11-08T17:38:04,348   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-11-08T17:38:04,349   !!

2024-11-08T17:38:04,350           ********************************************************************************
2024-11-08T17:38:04,351           ############################
2024-11-08T17:38:04,351           # Package would be ignored #
2024-11-08T17:38:04,352           ############################
2024-11-08T17:38:04,352           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-11-08T17:38:04,353           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,354           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,355           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-11-08T17:38:04,356           to the `packages` configuration field.

2024-11-08T17:38:04,357           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,357           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,358           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,359           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,361           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,362           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-11-08T17:38:04,362           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-11-08T17:38:04,363           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,363           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,364           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,365           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,366           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,368           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,368                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,369                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,369                 directory, all directories are treated like packages.
2024-11-08T17:38:04,370           ********************************************************************************

2024-11-08T17:38:04,371   !!
2024-11-08T17:38:04,371     check.warn(importable)
2024-11-08T17:38:04,372   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-11-08T17:38:04,372   !!

2024-11-08T17:38:04,373           ********************************************************************************
2024-11-08T17:38:04,374           ############################
2024-11-08T17:38:04,374           # Package would be ignored #
2024-11-08T17:38:04,375           ############################
2024-11-08T17:38:04,375           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-11-08T17:38:04,376           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,377           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,377           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-11-08T17:38:04,378           to the `packages` configuration field.

2024-11-08T17:38:04,379           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,379           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,380           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,380           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,381           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,382           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-11-08T17:38:04,382           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-11-08T17:38:04,383           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,383           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,384           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,385           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,385           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,387           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,387                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,388                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,388                 directory, all directories are treated like packages.
2024-11-08T17:38:04,389           ********************************************************************************

2024-11-08T17:38:04,390   !!
2024-11-08T17:38:04,390     check.warn(importable)
2024-11-08T17:38:04,390   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-11-08T17:38:04,391   !!

2024-11-08T17:38:04,392           ********************************************************************************
2024-11-08T17:38:04,392           ############################
2024-11-08T17:38:04,393           # Package would be ignored #
2024-11-08T17:38:04,393           ############################
2024-11-08T17:38:04,394           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-11-08T17:38:04,394           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,395           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,396           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-11-08T17:38:04,396           to the `packages` configuration field.

2024-11-08T17:38:04,397           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,398           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,398           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,399           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,400           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,401           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-11-08T17:38:04,402           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-11-08T17:38:04,402           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,403           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,404           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,405           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,406           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,407           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,407                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,408                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,408                 directory, all directories are treated like packages.
2024-11-08T17:38:04,408           ********************************************************************************

2024-11-08T17:38:04,409   !!
2024-11-08T17:38:04,410     check.warn(importable)
2024-11-08T17:38:04,410   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-11-08T17:38:04,410   !!

2024-11-08T17:38:04,411           ********************************************************************************
2024-11-08T17:38:04,412           ############################
2024-11-08T17:38:04,412           # Package would be ignored #
2024-11-08T17:38:04,412           ############################
2024-11-08T17:38:04,413           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-11-08T17:38:04,413           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,414           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,415           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-11-08T17:38:04,415           to the `packages` configuration field.

2024-11-08T17:38:04,416           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,417           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,417           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,418           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,419           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,420           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-11-08T17:38:04,420           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-11-08T17:38:04,421           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,421           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,422           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,423           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,424           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,425           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,426                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,426                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,427                 directory, all directories are treated like packages.
2024-11-08T17:38:04,427           ********************************************************************************

2024-11-08T17:38:04,428   !!
2024-11-08T17:38:04,429     check.warn(importable)
2024-11-08T17:38:04,429   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-11-08T17:38:04,430   !!

2024-11-08T17:38:04,431           ********************************************************************************
2024-11-08T17:38:04,431           ############################
2024-11-08T17:38:04,432           # Package would be ignored #
2024-11-08T17:38:04,432           ############################
2024-11-08T17:38:04,433           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-11-08T17:38:04,433           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,434           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,435           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-11-08T17:38:04,435           to the `packages` configuration field.

2024-11-08T17:38:04,436           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,436           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,437           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,438           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,439           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,440           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-11-08T17:38:04,440           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-11-08T17:38:04,441           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,441           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,442           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,443           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,443           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,445           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,446                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,446                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,447                 directory, all directories are treated like packages.
2024-11-08T17:38:04,447           ********************************************************************************

2024-11-08T17:38:04,448   !!
2024-11-08T17:38:04,449     check.warn(importable)
2024-11-08T17:38:04,449   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-11-08T17:38:04,450   !!

2024-11-08T17:38:04,451           ********************************************************************************
2024-11-08T17:38:04,451           ############################
2024-11-08T17:38:04,452           # Package would be ignored #
2024-11-08T17:38:04,452           ############################
2024-11-08T17:38:04,453           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-11-08T17:38:04,453           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,454           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,455           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-11-08T17:38:04,455           to the `packages` configuration field.

2024-11-08T17:38:04,456           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,457           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,457           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,458           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,459           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,460           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-11-08T17:38:04,461           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-11-08T17:38:04,461           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,462           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,462           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,463           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,464           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,466           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,466                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,466                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,467                 directory, all directories are treated like packages.
2024-11-08T17:38:04,467           ********************************************************************************

2024-11-08T17:38:04,469   !!
2024-11-08T17:38:04,469     check.warn(importable)
2024-11-08T17:38:04,470   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-11-08T17:38:04,470   !!

2024-11-08T17:38:04,471           ********************************************************************************
2024-11-08T17:38:04,472           ############################
2024-11-08T17:38:04,472           # Package would be ignored #
2024-11-08T17:38:04,473           ############################
2024-11-08T17:38:04,473           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-11-08T17:38:04,474           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,475           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,475           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-11-08T17:38:04,476           to the `packages` configuration field.

2024-11-08T17:38:04,477           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,477           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,478           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,479           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,480           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,481           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-11-08T17:38:04,482           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-11-08T17:38:04,482           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,482           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,483           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,484           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,485           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,487           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,487                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,488                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,489                 directory, all directories are treated like packages.
2024-11-08T17:38:04,489           ********************************************************************************

2024-11-08T17:38:04,490   !!
2024-11-08T17:38:04,491     check.warn(importable)
2024-11-08T17:38:04,491   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-11-08T17:38:04,492   !!

2024-11-08T17:38:04,493           ********************************************************************************
2024-11-08T17:38:04,493           ############################
2024-11-08T17:38:04,493           # Package would be ignored #
2024-11-08T17:38:04,494           ############################
2024-11-08T17:38:04,494           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-11-08T17:38:04,495           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,496           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,496           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-11-08T17:38:04,497           to the `packages` configuration field.

2024-11-08T17:38:04,498           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,498           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,498           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,499           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,501           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,502           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-11-08T17:38:04,502           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-11-08T17:38:04,503           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,503           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,504           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,505           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,506           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,507           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,508                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,508                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,509                 directory, all directories are treated like packages.
2024-11-08T17:38:04,509           ********************************************************************************

2024-11-08T17:38:04,510   !!
2024-11-08T17:38:04,511     check.warn(importable)
2024-11-08T17:38:04,511   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-11-08T17:38:04,512   !!

2024-11-08T17:38:04,513           ********************************************************************************
2024-11-08T17:38:04,514           ############################
2024-11-08T17:38:04,514           # Package would be ignored #
2024-11-08T17:38:04,515           ############################
2024-11-08T17:38:04,515           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-11-08T17:38:04,516           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,517           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,517           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-11-08T17:38:04,518           to the `packages` configuration field.

2024-11-08T17:38:04,519           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,519           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,520           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,521           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,522           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,523           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-11-08T17:38:04,523           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-11-08T17:38:04,523           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,524           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,524           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,526           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,527           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,528           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,529                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,529                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,530                 directory, all directories are treated like packages.
2024-11-08T17:38:04,530           ********************************************************************************

2024-11-08T17:38:04,531   !!
2024-11-08T17:38:04,532     check.warn(importable)
2024-11-08T17:38:04,532   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-11-08T17:38:04,533   !!

2024-11-08T17:38:04,534           ********************************************************************************
2024-11-08T17:38:04,535           ############################
2024-11-08T17:38:04,535           # Package would be ignored #
2024-11-08T17:38:04,536           ############################
2024-11-08T17:38:04,536           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-11-08T17:38:04,537           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,538           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,538           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-11-08T17:38:04,539           to the `packages` configuration field.

2024-11-08T17:38:04,540           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,540           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,541           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,542           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,543           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,544           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-11-08T17:38:04,544           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-11-08T17:38:04,545           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,545           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,546           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,547           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,548           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,549           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,550                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,550                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,551                 directory, all directories are treated like packages.
2024-11-08T17:38:04,551           ********************************************************************************

2024-11-08T17:38:04,552   !!
2024-11-08T17:38:04,552     check.warn(importable)
2024-11-08T17:38:04,553   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-11-08T17:38:04,553   !!

2024-11-08T17:38:04,554           ********************************************************************************
2024-11-08T17:38:04,554           ############################
2024-11-08T17:38:04,555           # Package would be ignored #
2024-11-08T17:38:04,555           ############################
2024-11-08T17:38:04,556           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-11-08T17:38:04,556           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,557           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,558           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-11-08T17:38:04,558           to the `packages` configuration field.

2024-11-08T17:38:04,559           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,560           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,560           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,561           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,562           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,563           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-11-08T17:38:04,564           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-11-08T17:38:04,564           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,565           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,565           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,566           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,567           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,569           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,569                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,570                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,570                 directory, all directories are treated like packages.
2024-11-08T17:38:04,571           ********************************************************************************

2024-11-08T17:38:04,572   !!
2024-11-08T17:38:04,572     check.warn(importable)
2024-11-08T17:38:04,573   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-11-08T17:38:04,573   !!

2024-11-08T17:38:04,574           ********************************************************************************
2024-11-08T17:38:04,575           ############################
2024-11-08T17:38:04,575           # Package would be ignored #
2024-11-08T17:38:04,576           ############################
2024-11-08T17:38:04,577           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-11-08T17:38:04,577           but it is absent from setuptools' `packages` configuration.

2024-11-08T17:38:04,578           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-08T17:38:04,579           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-11-08T17:38:04,579           to the `packages` configuration field.

2024-11-08T17:38:04,580           Alternatively, you can also rely on setuptools' discovery methods
2024-11-08T17:38:04,581           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-08T17:38:04,581           instead of `find_packages(...)`/`find:`).

2024-11-08T17:38:04,582           You can read more about "package discovery" on setuptools documentation page:

2024-11-08T17:38:04,583           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-08T17:38:04,584           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-11-08T17:38:04,584           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-11-08T17:38:04,585           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-08T17:38:04,585           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-08T17:38:04,586           combination with a more fine grained `package-data` configuration.

2024-11-08T17:38:04,586           You can read more about "package data files" on setuptools documentation page:

2024-11-08T17:38:04,587           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-08T17:38:04,589           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-08T17:38:04,589                 even if it does not contain any `.py` files.
2024-11-08T17:38:04,590                 On the other hand, currently there is no concept of package data
2024-11-08T17:38:04,590                 directory, all directories are treated like packages.
2024-11-08T17:38:04,591           ********************************************************************************

2024-11-08T17:38:04,592   !!
2024-11-08T17:38:04,592     check.warn(importable)
2024-11-08T17:38:04,593   creating build/lib/deepspeed/ops/csrc/adagrad
2024-11-08T17:38:04,593   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-11-08T17:38:04,594   creating build/lib/deepspeed/ops/csrc/adam
2024-11-08T17:38:04,594   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-11-08T17:38:04,595   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-11-08T17:38:04,595   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-11-08T17:38:04,596   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-11-08T17:38:04,596   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-11-08T17:38:04,597   creating build/lib/deepspeed/ops/csrc/aio/common
2024-11-08T17:38:04,597   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-08T17:38:04,598   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-08T17:38:04,598   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-08T17:38:04,599   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-08T17:38:04,599   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-08T17:38:04,600   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-08T17:38:04,600   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,601   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,601   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,602   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,602   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,603   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,603   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,604   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,604   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,605   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,605   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,606   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,606   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,607   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,607   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,607   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,608   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,608   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:04,609   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-11-08T17:38:04,609   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-11-08T17:38:04,610   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-11-08T17:38:04,610   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-11-08T17:38:04,611   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:04,611   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:04,612   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:04,612   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:04,613   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:04,613   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-11-08T17:38:04,614   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-11-08T17:38:04,614   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:04,615   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:04,615   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:04,616   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:04,617   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:04,617   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:04,618   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:04,619   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:04,619   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:04,620   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:04,620   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:04,621   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:04,621   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:04,621   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:04,622   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:04,622   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:04,623   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:04,623   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:04,624   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:04,624   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:04,625   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:04,625   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:04,626   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:04,626   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:04,627   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:04,627   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:04,628   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:04,628   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:04,629   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-08T17:38:04,629   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-08T17:38:04,630   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-08T17:38:04,631   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-11-08T17:38:04,631   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-11-08T17:38:04,631   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-11-08T17:38:04,632   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-11-08T17:38:04,632   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-11-08T17:38:04,633   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-11-08T17:38:04,633   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:04,633   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:04,634   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:04,634   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:04,635   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:04,635   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:04,636   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:04,636   creating build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,637   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,637   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,638   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,638   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,639   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,639   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,640   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,640   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,641   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,641   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,642   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,642   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,643   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,643   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,644   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,645   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,645   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,646   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,646   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,648   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,651   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,654   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,656   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,659   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,661   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,664   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,667   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,669   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,671   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-08T17:38:04,674   creating build/lib/deepspeed/ops/csrc/lamb
2024-11-08T17:38:04,675   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-11-08T17:38:04,677   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-11-08T17:38:04,680   creating build/lib/deepspeed/ops/csrc/lion
2024-11-08T17:38:04,681   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-11-08T17:38:04,683   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-11-08T17:38:04,686   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-11-08T17:38:04,688   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-11-08T17:38:04,691   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-11-08T17:38:04,693   creating build/lib/deepspeed/ops/csrc/quantization
2024-11-08T17:38:04,694   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-08T17:38:04,697   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-08T17:38:04,700   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-11-08T17:38:04,703   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-08T17:38:04,706   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-08T17:38:04,708   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-08T17:38:04,711   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-08T17:38:04,714   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:04,715   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:04,718   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:04,720   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:04,723   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:04,726   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-11-08T17:38:04,727   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-11-08T17:38:04,730   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-11-08T17:38:04,732   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-11-08T17:38:04,735   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-11-08T17:38:04,737   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-11-08T17:38:04,738   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-11-08T17:38:04,740   creating build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,741   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,744   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,747   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,750   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,753   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,755   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,759   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,762   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-08T17:38:04,764   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,766   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,769   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,771   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,774   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,777   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,780   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,784   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,786   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,789   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,792   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:04,795   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-11-08T17:38:04,796   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-11-08T17:38:04,799   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-11-08T17:38:04,802   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-11-08T17:38:04,805   creating build/lib/deepspeed/ops/csrc/utils
2024-11-08T17:38:04,806   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-11-08T17:38:04,808   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-11-08T17:38:04,810   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-11-08T17:38:04,813   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-11-08T17:38:04,814   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-11-08T17:38:04,817   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-11-08T17:38:04,819   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-11-08T17:38:04,822   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-11-08T17:38:04,823   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-11-08T17:38:04,826   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:04,827   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:04,829   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:04,831   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:04,833   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:04,836   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:04,838   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-11-08T17:38:04,840   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-11-08T17:38:04,842   creating build/lib/deepspeed/autotuning/config_templates
2024-11-08T17:38:04,843   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-11-08T17:38:04,845   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-11-08T17:38:04,847   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-11-08T17:38:04,850   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-11-08T17:38:04,852   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:38:04,855   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:38:04,857   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:38:04,859   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:04,860   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:04,862   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:04,865   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:04,867   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:04,870   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:04,873   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-11-08T17:38:04,874   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-11-08T17:38:04,877   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-11-08T17:38:04,879   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-11-08T17:38:04,880   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-11-08T17:38:04,883   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-11-08T17:38:04,885   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-11-08T17:38:04,887   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-11-08T17:38:04,888   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-11-08T17:38:04,890   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-08T17:38:04,891   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-08T17:38:04,893   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-08T17:38:04,895   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-08T17:38:04,897   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-11-08T17:38:04,899   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-11-08T17:38:04,900   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-11-08T17:38:04,903   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:04,905   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:04,907   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:04,910   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:04,912   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:04,914   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:04,917   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:04,919   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:04,922   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:04,925   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:38:04,927   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:38:04,930   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:04,933   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:04,935   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:04,938   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:04,940   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,941   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,943   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,946   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,948   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,950   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,953   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,955   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,958   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,960   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:04,963   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:04,965   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:04,967   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:04,970   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:04,973   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:04,975   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:04,977   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:04,979   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:04,982   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:04,985   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:04,987   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:04,991   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:04,994   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:04,996   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:04,999   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:05,002   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:05,004   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:05,007   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:05,009   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:05,011   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:05,014   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:05,016   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:05,019   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:05,022   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:05,024   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:05,027   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:05,029   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:05,032   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:38:05,035   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:38:05,037   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:05,040   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:05,043   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:05,045   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:05,048   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:05,051   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:05,053   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:05,056   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:05,059   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:05,061   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:05,114   running build_scripts
2024-11-08T17:38:05,115   creating build/scripts-3.11
2024-11-08T17:38:05,118   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-11-08T17:38:05,120   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-11-08T17:38:05,122   copying and adjusting bin/ds -> build/scripts-3.11
2024-11-08T17:38:05,124   copying bin/ds_ssh -> build/scripts-3.11
2024-11-08T17:38:05,127   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-11-08T17:38:05,128   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-11-08T17:38:05,130   copying and adjusting bin/dsr -> build/scripts-3.11
2024-11-08T17:38:05,132   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-11-08T17:38:05,134   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2024-11-08T17:38:05,136   copying and adjusting bin/ds_io -> build/scripts-3.11
2024-11-08T17:38:05,137   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-11-08T17:38:05,138   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-11-08T17:38:05,139   changing mode of build/scripts-3.11/ds from 644 to 755
2024-11-08T17:38:05,139   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-11-08T17:38:05,140   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-11-08T17:38:05,141   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-11-08T17:38:05,142   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-11-08T17:38:05,142   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2024-11-08T17:38:05,143   changing mode of build/scripts-3.11/ds_io from 644 to 755
2024-11-08T17:38:05,171   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-11-08T17:38:05,172   !!

2024-11-08T17:38:05,173           ********************************************************************************
2024-11-08T17:38:05,174           Please avoid running ``setup.py`` directly.
2024-11-08T17:38:05,175           Instead, use pypa/build, pypa/installer or other
2024-11-08T17:38:05,175           standards-based tools.

2024-11-08T17:38:05,177           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-11-08T17:38:05,177           ********************************************************************************

2024-11-08T17:38:05,179   !!
2024-11-08T17:38:05,179     self.initialize_options()
2024-11-08T17:38:05,204   installing to build/bdist.linux-armv7l/wheel
2024-11-08T17:38:05,204   running install
2024-11-08T17:38:05,229   running install_lib
2024-11-08T17:38:05,257   creating build/bdist.linux-armv7l/wheel
2024-11-08T17:38:05,260   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-11-08T17:38:05,262   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-11-08T17:38:05,264   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-11-08T17:38:05,266   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,269   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,271   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,274   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-11-08T17:38:05,276   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-08T17:38:05,279   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-08T17:38:05,281   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-08T17:38:05,283   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-08T17:38:05,286   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-08T17:38:05,288   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-08T17:38:05,290   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-08T17:38:05,292   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,295   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,297   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,299   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,302   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,304   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,306   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,309   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,311   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,314   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,316   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,319   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,321   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,323   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,325   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,328   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-08T17:38:05,330   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,333   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,335   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,338   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,340   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,342   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,345   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,348   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,350   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,353   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,355   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,358   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,360   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-08T17:38:05,363   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-11-08T17:38:05,365   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-11-08T17:38:05,366   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-11-08T17:38:05,369   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-11-08T17:38:05,372   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-11-08T17:38:05,373   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-11-08T17:38:05,375   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-11-08T17:38:05,378   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-11-08T17:38:05,380   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-11-08T17:38:05,382   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-11-08T17:38:05,384   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-11-08T17:38:05,386   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-11-08T17:38:05,388   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-11-08T17:38:05,391   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-11-08T17:38:05,393   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-11-08T17:38:05,396   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-11-08T17:38:05,398   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-11-08T17:38:05,400   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-11-08T17:38:05,402   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-11-08T17:38:05,405   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-11-08T17:38:05,406   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-11-08T17:38:05,410   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-11-08T17:38:05,411   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-11-08T17:38:05,414   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-11-08T17:38:05,417   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-11-08T17:38:05,419   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:05,421   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:05,424   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:05,426   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:05,428   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:05,431   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-08T17:38:05,434   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-11-08T17:38:05,435   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-11-08T17:38:05,438   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-11-08T17:38:05,440   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-11-08T17:38:05,442   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-11-08T17:38:05,445   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-11-08T17:38:05,446   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-11-08T17:38:05,449   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:05,451   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:05,454   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:05,456   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:05,459   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-11-08T17:38:05,461   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-11-08T17:38:05,462   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-11-08T17:38:05,465   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-11-08T17:38:05,468   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-11-08T17:38:05,469   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-08T17:38:05,472   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-08T17:38:05,474   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-08T17:38:05,476   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-08T17:38:05,479   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-08T17:38:05,481   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-08T17:38:05,483   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-08T17:38:05,486   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-11-08T17:38:05,487   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-11-08T17:38:05,490   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-11-08T17:38:05,492   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-11-08T17:38:05,494   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-08T17:38:05,496   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-08T17:38:05,498   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-08T17:38:05,500   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-08T17:38:05,502   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-08T17:38:05,504   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-08T17:38:05,506   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-11-08T17:38:05,507   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-11-08T17:38:05,510   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,511   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,513   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,515   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,516   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,518   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,520   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,522   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,524   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,526   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,528   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,530   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,532   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,533   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,535   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,538   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,540   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,541   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-08T17:38:05,544   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-11-08T17:38:05,545   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-08T17:38:05,547   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-08T17:38:05,549   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-08T17:38:05,551   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-08T17:38:05,553   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-08T17:38:05,555   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-11-08T17:38:05,556   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-11-08T17:38:05,559   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:05,560   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:05,562   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:05,565   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:05,567   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-11-08T17:38:05,570   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,571   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,574   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-11-08T17:38:05,576   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,578   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,580   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,582   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,584   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,587   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,590   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,593   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,595   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,597   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,600   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-08T17:38:05,603   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-11-08T17:38:05,605   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-11-08T17:38:05,607   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-11-08T17:38:05,610   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-11-08T17:38:05,612   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,615   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,618   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,620   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,624   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,627   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,630   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-08T17:38:05,633   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-11-08T17:38:05,635   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-08T17:38:05,637   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-08T17:38:05,639   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-08T17:38:05,641   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-08T17:38:05,644   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-08T17:38:05,646   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-11-08T17:38:05,648   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:05,649   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:05,652   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:05,657   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:05,658   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:05,660   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:05,664   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:05,666   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:05,669   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:05,673   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:05,676   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-08T17:38:05,679   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:05,681   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:05,683   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:05,686   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:05,689   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-08T17:38:05,691   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:05,695   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:05,696   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:05,699   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:05,702   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:05,704   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:05,707   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:05,711   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:05,713   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-08T17:38:05,716   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:05,718   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:05,721   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-08T17:38:05,722   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-08T17:38:05,725   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-08T17:38:05,727   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-08T17:38:05,730   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-11-08T17:38:05,731   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-11-08T17:38:05,734   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-11-08T17:38:05,736   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-11-08T17:38:05,737   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-11-08T17:38:05,740   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-11-08T17:38:05,742   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-11-08T17:38:05,743   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-11-08T17:38:05,746   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-11-08T17:38:05,748   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,751   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,753   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,756   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,758   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,760   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,762   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,764   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,766   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,768   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,770   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,772   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,775   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,778   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,780   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,783   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,786   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,788   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,791   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,793   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,795   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,798   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,800   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,803   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,805   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,808   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,811   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,813   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,816   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-08T17:38:05,819   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-11-08T17:38:05,821   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-11-08T17:38:05,824   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-11-08T17:38:05,826   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-11-08T17:38:05,828   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-11-08T17:38:05,831   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-11-08T17:38:05,835   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2024-11-08T17:38:05,837   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:05,839   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:05,842   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:05,844   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:05,847   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:05,849   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:05,851   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-08T17:38:05,855   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-11-08T17:38:05,856   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-11-08T17:38:05,858   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-11-08T17:38:05,861   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-11-08T17:38:05,863   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-11-08T17:38:05,865   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-11-08T17:38:05,869   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-11-08T17:38:05,870   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-11-08T17:38:05,874   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-11-08T17:38:05,875   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,877   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,880   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,881   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,883   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,885   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,887   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,889   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,891   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,893   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,895   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,897   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,899   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,901   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,902   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,904   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,906   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,909   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,910   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,912   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,914   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,916   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,918   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,919   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,921   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,923   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-08T17:38:05,926   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,927   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,930   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,932   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,934   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,936   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,938   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,940   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,943   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,945   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,947   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-08T17:38:05,949   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,951   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,953   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,955   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,958   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,960   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,962   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,964   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-08T17:38:05,966   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-11-08T17:38:05,969   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-11-08T17:38:05,970   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-11-08T17:38:05,972   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-11-08T17:38:05,974   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-11-08T17:38:05,976   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-11-08T17:38:05,979   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-11-08T17:38:05,980   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-11-08T17:38:05,982   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-11-08T17:38:05,984   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-11-08T17:38:05,986   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-08T17:38:05,988   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-08T17:38:05,990   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-08T17:38:05,992   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-08T17:38:05,995   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:38:05,996   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:38:05,998   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:38:06,000   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:38:06,002   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-11-08T17:38:06,004   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-08T17:38:06,007   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-08T17:38:06,009   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-08T17:38:06,012   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-11-08T17:38:06,014   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,016   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,017   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,020   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,021   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,023   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,025   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,027   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,029   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,031   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,033   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,035   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-08T17:38:06,037   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,039   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,040   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,043   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-11-08T17:38:06,044   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-08T17:38:06,047   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-08T17:38:06,048   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-08T17:38:06,050   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-08T17:38:06,052   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-08T17:38:06,054   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-08T17:38:06,056   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-08T17:38:06,057   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,059   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,061   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,063   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,064   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,067   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,068   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,070   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,072   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,074   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,076   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,078   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,080   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,082   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,084   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-08T17:38:06,085   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,087   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,089   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,091   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,093   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,095   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,097   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,099   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,102   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-11-08T17:38:06,103   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-08T17:38:06,105   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-08T17:38:06,107   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-08T17:38:06,109   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-08T17:38:06,111   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-08T17:38:06,112   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-08T17:38:06,114   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,116   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,119   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2024-11-08T17:38:06,120   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-08T17:38:06,122   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-08T17:38:06,123   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-08T17:38:06,125   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-08T17:38:06,127   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-08T17:38:06,128   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-08T17:38:06,130   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,132   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,134   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,136   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,138   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-08T17:38:06,141   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-11-08T17:38:06,142   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-11-08T17:38:06,145   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-11-08T17:38:06,147   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-11-08T17:38:06,150   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2024-11-08T17:38:06,152   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2024-11-08T17:38:06,155   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-11-08T17:38:06,157   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-11-08T17:38:06,159   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-11-08T17:38:06,161   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-11-08T17:38:06,163   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-08T17:38:06,165   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-08T17:38:06,167   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-08T17:38:06,170   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-08T17:38:06,172   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-08T17:38:06,175   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-11-08T17:38:06,176   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-11-08T17:38:06,179   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-11-08T17:38:06,183   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-11-08T17:38:06,185   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-11-08T17:38:06,187   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-11-08T17:38:06,189   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-11-08T17:38:06,191   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-11-08T17:38:06,193   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-11-08T17:38:06,195   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-11-08T17:38:06,199   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-11-08T17:38:06,200   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-11-08T17:38:06,203   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-11-08T17:38:06,206   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-11-08T17:38:06,207   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-11-08T17:38:06,210   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-11-08T17:38:06,212   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-11-08T17:38:06,214   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-11-08T17:38:06,216   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-11-08T17:38:06,219   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-08T17:38:06,221   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-08T17:38:06,223   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-08T17:38:06,226   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-08T17:38:06,229   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-11-08T17:38:06,230   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-11-08T17:38:06,232   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-11-08T17:38:06,235   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-11-08T17:38:06,237   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-11-08T17:38:06,239   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-11-08T17:38:06,242   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-11-08T17:38:06,244   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-11-08T17:38:06,246   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-11-08T17:38:06,249   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,250   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,253   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,255   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,257   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,259   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,262   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,264   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,266   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-08T17:38:06,269   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-11-08T17:38:06,273   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-11-08T17:38:06,275   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-08T17:38:06,277   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-08T17:38:06,279   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-08T17:38:06,282   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-08T17:38:06,283   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-08T17:38:06,286   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-08T17:38:06,288   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-08T17:38:06,290   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-11-08T17:38:06,292   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,294   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,297   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,298   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,301   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-11-08T17:38:06,303   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-11-08T17:38:06,305   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-11-08T17:38:06,308   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-11-08T17:38:06,310   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-11-08T17:38:06,313   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,316   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-11-08T17:38:06,318   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-11-08T17:38:06,320   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-11-08T17:38:06,322   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:06,324   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:06,327   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:06,329   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:06,331   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:06,334   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-08T17:38:06,337   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:06,338   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:06,341   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:06,343   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:06,345   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:06,347   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:06,350   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:06,352   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-08T17:38:06,354   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-11-08T17:38:06,357   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,358   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,360   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,362   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,365   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,367   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,369   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,371   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,374   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-08T17:38:06,376   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-11-08T17:38:06,379   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:38:06,380   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:38:06,382   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:38:06,384   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:38:06,387   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-08T17:38:06,390   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:06,391   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:06,393   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:06,395   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:06,397   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:06,400   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,401   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,403   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,405   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,407   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,411   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,413   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,416   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,419   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,421   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-08T17:38:06,424   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:06,426   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-08T17:38:06,429   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:06,430   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:06,432   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:06,434   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:06,436   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:06,438   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-08T17:38:06,440   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-11-08T17:38:06,443   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-11-08T17:38:06,445   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:06,446   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:06,448   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:06,450   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:06,452   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:06,454   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:06,456   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-08T17:38:06,458   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,460   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,462   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,464   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,466   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,468   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,470   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,472   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,475   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-08T17:38:06,477   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-11-08T17:38:06,479   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:06,481   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:06,483   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:06,484   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:06,486   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:06,488   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:06,490   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-08T17:38:06,493   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:06,494   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:06,496   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:06,498   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:06,500   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:06,502   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:06,503   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-08T17:38:06,506   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-08T17:38:06,507   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-08T17:38:06,509   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-08T17:38:06,511   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-08T17:38:06,514   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:06,515   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:06,517   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:06,519   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:06,521   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:06,522   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:06,524   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-08T17:38:06,527   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:06,528   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:06,530   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:06,532   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:06,533   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:06,535   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:06,538   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-08T17:38:06,540   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-11-08T17:38:06,543   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:38:06,544   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:38:06,546   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:38:06,548   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:38:06,549   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-08T17:38:06,552   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:06,553   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:06,555   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:06,557   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:06,559   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:06,560   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:06,562   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-08T17:38:06,564   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-11-08T17:38:06,566   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-11-08T17:38:06,568   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:06,569   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:06,572   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:06,575   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:06,576   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:06,579   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-08T17:38:06,582   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-11-08T17:38:06,584   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-11-08T17:38:06,587   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:06,589   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:06,592   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:06,594   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:06,597   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:06,599   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:06,602   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-08T17:38:06,604   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-11-08T17:38:06,607   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-11-08T17:38:06,609   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-11-08T17:38:06,612   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:06,614   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:06,617   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:06,619   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:06,621   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:06,623   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-08T17:38:06,626   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,629   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,632   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-11-08T17:38:06,634   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:38:06,636   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:38:06,638   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:38:06,641   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:38:06,643   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-11-08T17:38:06,646   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,648   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,650   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,653   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,655   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,657   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,660   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,662   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,664   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,667   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-08T17:38:06,670   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-08T17:38:06,672   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:38:06,674   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:38:06,677   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:38:06,679   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:38:06,681   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-11-08T17:38:06,683   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-08T17:38:06,685   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-08T17:38:06,688   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:38:06,689   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:38:06,692   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:38:06,693   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:38:06,695   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-11-08T17:38:06,698   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:38:06,699   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:38:06,702   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:38:06,703   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:38:06,705   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-08T17:38:06,708   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,709   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,711   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,713   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,715   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,717   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,718   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,720   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,722   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,724   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-08T17:38:06,727   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-08T17:38:06,729   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:38:06,730   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:38:06,733   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:38:06,735   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:38:06,737   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-08T17:38:06,739   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-08T17:38:06,742   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:38:06,743   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:38:06,746   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:38:06,747   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:38:06,750   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-11-08T17:38:06,752   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:38:06,754   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:38:06,756   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:38:06,758   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:38:06,759   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-11-08T17:38:06,762   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:38:06,763   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:38:06,765   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:38:06,767   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:38:06,769   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-11-08T17:38:06,771   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:38:06,773   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:38:06,775   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:38:06,777   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:38:06,779   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-11-08T17:38:06,782   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-08T17:38:06,785   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:38:06,786   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:38:06,788   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:38:06,790   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:38:06,792   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-11-08T17:38:06,794   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-08T17:38:06,797   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-11-08T17:38:06,799   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-08T17:38:06,800   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-08T17:38:06,803   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-08T17:38:06,805   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-11-08T17:38:06,806   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-11-08T17:38:06,808   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-11-08T17:38:06,810   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-08T17:38:06,812   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-08T17:38:06,815   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-08T17:38:06,818   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-11-08T17:38:06,819   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-11-08T17:38:06,821   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-08T17:38:06,824   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,826   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-08T17:38:06,828   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-08T17:38:06,831   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-11-08T17:38:06,832   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-08T17:38:06,835   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-08T17:38:06,837   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-08T17:38:06,838   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-08T17:38:06,841   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-08T17:38:06,843   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-08T17:38:06,846   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-11-08T17:38:06,847   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-08T17:38:06,850   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-08T17:38:06,853   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-11-08T17:38:06,854   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-11-08T17:38:06,856   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-11-08T17:38:06,858   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-11-08T17:38:06,859   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-11-08T17:38:06,861   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-08T17:38:06,864   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-11-08T17:38:06,865   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-08T17:38:06,867   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-08T17:38:06,869   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-08T17:38:06,871   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-08T17:38:06,872   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-08T17:38:06,875   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-08T17:38:06,877   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-08T17:38:06,879   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-08T17:38:06,881   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-08T17:38:06,884   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-11-08T17:38:06,885   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-08T17:38:06,887   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-08T17:38:06,889   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-08T17:38:06,891   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-08T17:38:06,892   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-08T17:38:06,894   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-08T17:38:06,896   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-08T17:38:06,898   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-08T17:38:06,901   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-11-08T17:38:06,902   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,904   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,906   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,908   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,911   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,913   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,916   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,918   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,920   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,922   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-08T17:38:06,926   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-11-08T17:38:06,927   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,928   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,930   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,932   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,934   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,936   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,938   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,940   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,943   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,944   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,946   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,948   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,950   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,953   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,955   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,957   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,959   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,961   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-08T17:38:06,964   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-11-08T17:38:06,965   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-08T17:38:06,967   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-08T17:38:06,969   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-08T17:38:06,972   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-08T17:38:06,975   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-08T17:38:06,976   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-08T17:38:06,978   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-08T17:38:06,981   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-11-08T17:38:06,982   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-08T17:38:06,984   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-08T17:38:06,986   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-08T17:38:06,988   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-08T17:38:06,991   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-08T17:38:06,994   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-08T17:38:06,996   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-08T17:38:06,998   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-08T17:38:07,001   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-11-08T17:38:07,002   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,004   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,006   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,008   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,010   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,012   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,014   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,016   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,019   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,021   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-08T17:38:07,023   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2024-11-08T17:38:07,025   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,027   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,030   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,031   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,033   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,035   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,038   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,039   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,041   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,043   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,045   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,047   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-08T17:38:07,049   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-08T17:38:07,052   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-11-08T17:38:07,053   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,055   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,058   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,059   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,062   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,064   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,066   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,068   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,070   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-08T17:38:07,072   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-11-08T17:38:07,074   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-11-08T17:38:07,075   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-11-08T17:38:07,077   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-11-08T17:38:07,079   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-11-08T17:38:07,081   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-11-08T17:38:07,082   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-11-08T17:38:07,084   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-11-08T17:38:07,086   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-11-08T17:38:07,089   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-11-08T17:38:07,090   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,092   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,094   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,096   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,098   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,099   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,101   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,104   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,106   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,107   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-08T17:38:07,110   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-11-08T17:38:07,111   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-08T17:38:07,113   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-08T17:38:07,115   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-08T17:38:07,118   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-08T17:38:07,120   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-08T17:38:07,122   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-08T17:38:07,124   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-11-08T17:38:07,125   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-11-08T17:38:07,127   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-11-08T17:38:07,128   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-11-08T17:38:07,130   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-11-08T17:38:07,133   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-11-08T17:38:07,135   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-11-08T17:38:07,137   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-08T17:38:07,140   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-11-08T17:38:07,141   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-08T17:38:07,143   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-08T17:38:07,145   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-08T17:38:07,147   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-08T17:38:07,149   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-08T17:38:07,152   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-11-08T17:38:07,154   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,157   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-11-08T17:38:07,158   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-11-08T17:38:07,160   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-11-08T17:38:07,162   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-11-08T17:38:07,166   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-11-08T17:38:07,167   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-11-08T17:38:07,169   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-11-08T17:38:07,171   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-11-08T17:38:07,174   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-11-08T17:38:07,177   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-11-08T17:38:07,180   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-11-08T17:38:07,181   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-08T17:38:07,184   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-08T17:38:07,185   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-08T17:38:07,188   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-08T17:38:07,191   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-08T17:38:07,194   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-08T17:38:07,196   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,200   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-11-08T17:38:07,201   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-11-08T17:38:07,204   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-11-08T17:38:07,206   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-11-08T17:38:07,208   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,210   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,213   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,215   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,217   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,219   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,221   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,224   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,226   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,229   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,230   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,232   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,234   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,237   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-08T17:38:07,239   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,242   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,247   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,248   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,251   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-11-08T17:38:07,252   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-11-08T17:38:07,254   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-11-08T17:38:07,256   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-11-08T17:38:07,258   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-11-08T17:38:07,260   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-11-08T17:38:07,261   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-11-08T17:38:07,263   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-11-08T17:38:07,265   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,268   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-11-08T17:38:07,269   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-11-08T17:38:07,272   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:38:07,273   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:38:07,275   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:38:07,277   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:38:07,279   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:38:07,281   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-08T17:38:07,284   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:38:07,285   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:38:07,287   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:38:07,290   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:38:07,292   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:38:07,296   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-08T17:38:07,297   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-11-08T17:38:07,300   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-11-08T17:38:07,302   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-11-08T17:38:07,305   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-11-08T17:38:07,307   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-08T17:38:07,308   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-08T17:38:07,310   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-08T17:38:07,313   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-08T17:38:07,315   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-08T17:38:07,317   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-08T17:38:07,319   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,322   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,324   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-11-08T17:38:07,326   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,328   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,333   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,335   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,340   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,343   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,346   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,348   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,349   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,353   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,355   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,357   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,362   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,364   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,367   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,369   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,372   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-08T17:38:07,376   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,378   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,381   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,385   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,388   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-08T17:38:07,392   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-08T17:38:07,395   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-11-08T17:38:07,397   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-11-08T17:38:07,400   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-11-08T17:38:07,402   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-11-08T17:38:07,406   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-11-08T17:38:07,408   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-11-08T17:38:07,410   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-11-08T17:38:07,413   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-11-08T17:38:07,416   running install_egg_info
2024-11-08T17:38:07,462   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.15.4-py3.11.egg-info
2024-11-08T17:38:07,480   running install_scripts
2024-11-08T17:38:07,482   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,484   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,487   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,488   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,490   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,492   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,494   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,497   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,499   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,501   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,503   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts
2024-11-08T17:38:07,505   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/deepspeed.pt to 755
2024-11-08T17:38:07,506   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/ds_report to 755
2024-11-08T17:38:07,507   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/ds_ssh to 755
2024-11-08T17:38:07,508   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/ds_nvme_tune to 755
2024-11-08T17:38:07,508   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/ds_io to 755
2024-11-08T17:38:07,509   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/dsr to 755
2024-11-08T17:38:07,510   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/deepspeed to 755
2024-11-08T17:38:07,511   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/ds_bench to 755
2024-11-08T17:38:07,511   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/ds to 755
2024-11-08T17:38:07,512   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.data/scripts/ds_elastic to 755
2024-11-08T17:38:07,562   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.4.dist-info/WHEEL
2024-11-08T17:38:07,565   creating '/tmp/pip-wheel-a4yvs4v7/deepspeed-0.15.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-11-08T17:38:07,569   adding 'deepspeed/__init__.py'
2024-11-08T17:38:07,571   adding 'deepspeed/constants.py'
2024-11-08T17:38:07,573   adding 'deepspeed/env_report.py'
2024-11-08T17:38:07,575   adding 'deepspeed/git_version_info.py'
2024-11-08T17:38:07,577   adding 'deepspeed/git_version_info_installed.py'
2024-11-08T17:38:07,579   adding 'deepspeed/accelerator/__init__.py'
2024-11-08T17:38:07,581   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-11-08T17:38:07,583   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-11-08T17:38:07,585   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-11-08T17:38:07,587   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-11-08T17:38:07,589   adding 'deepspeed/accelerator/mlu_accelerator.py'
2024-11-08T17:38:07,591   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-11-08T17:38:07,593   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-11-08T17:38:07,595   adding 'deepspeed/accelerator/real_accelerator.py'
2024-11-08T17:38:07,597   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-11-08T17:38:07,599   adding 'deepspeed/autotuning/__init__.py'
2024-11-08T17:38:07,605   adding 'deepspeed/autotuning/autotuner.py'
2024-11-08T17:38:07,607   adding 'deepspeed/autotuning/config.py'
2024-11-08T17:38:07,609   adding 'deepspeed/autotuning/constants.py'
2024-11-08T17:38:07,611   adding 'deepspeed/autotuning/scheduler.py'
2024-11-08T17:38:07,614   adding 'deepspeed/autotuning/utils.py'
2024-11-08T17:38:07,616   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-11-08T17:38:07,617   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-11-08T17:38:07,619   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-11-08T17:38:07,620   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-11-08T17:38:07,622   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-11-08T17:38:07,624   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-11-08T17:38:07,626   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-11-08T17:38:07,627   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-11-08T17:38:07,629   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-11-08T17:38:07,631   adding 'deepspeed/autotuning/tuner/utils.py'
2024-11-08T17:38:07,633   adding 'deepspeed/checkpoint/__init__.py'
2024-11-08T17:38:07,634   adding 'deepspeed/checkpoint/constants.py'
2024-11-08T17:38:07,637   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-11-08T17:38:07,640   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-11-08T17:38:07,642   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-11-08T17:38:07,644   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-11-08T17:38:07,645   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-11-08T17:38:07,647   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-11-08T17:38:07,649   adding 'deepspeed/checkpoint/utils.py'
2024-11-08T17:38:07,651   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-11-08T17:38:07,653   adding 'deepspeed/comm/__init__.py'
2024-11-08T17:38:07,655   adding 'deepspeed/comm/backend.py'
2024-11-08T17:38:07,657   adding 'deepspeed/comm/ccl.py'
2024-11-08T17:38:07,660   adding 'deepspeed/comm/comm.py'
2024-11-08T17:38:07,662   adding 'deepspeed/comm/config.py'
2024-11-08T17:38:07,664   adding 'deepspeed/comm/constants.py'
2024-11-08T17:38:07,666   adding 'deepspeed/comm/reduce_op.py'
2024-11-08T17:38:07,668   adding 'deepspeed/comm/torch.py'
2024-11-08T17:38:07,670   adding 'deepspeed/comm/utils.py'
2024-11-08T17:38:07,672   adding 'deepspeed/compression/__init__.py'
2024-11-08T17:38:07,676   adding 'deepspeed/compression/basic_layer.py'
2024-11-08T17:38:07,678   adding 'deepspeed/compression/compress.py'
2024-11-08T17:38:07,680   adding 'deepspeed/compression/config.py'
2024-11-08T17:38:07,682   adding 'deepspeed/compression/constants.py'
2024-11-08T17:38:07,685   adding 'deepspeed/compression/helper.py'
2024-11-08T17:38:07,687   adding 'deepspeed/compression/scheduler.py'
2024-11-08T17:38:07,688   adding 'deepspeed/compression/utils.py'
2024-11-08T17:38:07,690   adding 'deepspeed/elasticity/__init__.py'
2024-11-08T17:38:07,692   adding 'deepspeed/elasticity/config.py'
2024-11-08T17:38:07,694   adding 'deepspeed/elasticity/constants.py'
2024-11-08T17:38:07,695   adding 'deepspeed/elasticity/elastic_agent.py'
2024-11-08T17:38:07,698   adding 'deepspeed/elasticity/elasticity.py'
2024-11-08T17:38:07,699   adding 'deepspeed/elasticity/utils.py'
2024-11-08T17:38:07,700   adding 'deepspeed/inference/__init__.py'
2024-11-08T17:38:07,702   adding 'deepspeed/inference/config.py'
2024-11-08T17:38:07,706   adding 'deepspeed/inference/engine.py'
2024-11-08T17:38:07,707   adding 'deepspeed/inference/quantization/__init__.py'
2024-11-08T17:38:07,709   adding 'deepspeed/inference/quantization/layers.py'
2024-11-08T17:38:07,710   adding 'deepspeed/inference/quantization/quantization.py'
2024-11-08T17:38:07,711   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-11-08T17:38:07,713   adding 'deepspeed/inference/quantization/utils.py'
2024-11-08T17:38:07,715   adding 'deepspeed/inference/v2/__init__.py'
2024-11-08T17:38:07,716   adding 'deepspeed/inference/v2/allocator.py'
2024-11-08T17:38:07,718   adding 'deepspeed/inference/v2/config_v2.py'
2024-11-08T17:38:07,719   adding 'deepspeed/inference/v2/engine_factory.py'
2024-11-08T17:38:07,721   adding 'deepspeed/inference/v2/engine_v2.py'
2024-11-08T17:38:07,722   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-11-08T17:38:07,723   adding 'deepspeed/inference/v2/inference_utils.py'
2024-11-08T17:38:07,725   adding 'deepspeed/inference/v2/logging.py'
2024-11-08T17:38:07,726   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-11-08T17:38:07,728   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-11-08T17:38:07,729   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-11-08T17:38:07,730   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-11-08T17:38:07,732   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-11-08T17:38:07,733   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-11-08T17:38:07,735   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-11-08T17:38:07,736   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-11-08T17:38:07,738   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-11-08T17:38:07,739   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-11-08T17:38:07,741   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-11-08T17:38:07,742   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-11-08T17:38:07,743   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-11-08T17:38:07,745   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-11-08T17:38:07,746   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-11-08T17:38:07,748   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-11-08T17:38:07,749   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-11-08T17:38:07,751   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-11-08T17:38:07,752   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-11-08T17:38:07,754   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-11-08T17:38:07,755   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-11-08T17:38:07,756   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-11-08T17:38:07,757   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-11-08T17:38:07,759   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-11-08T17:38:07,760   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-11-08T17:38:07,762   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-11-08T17:38:07,763   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-11-08T17:38:07,765   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-11-08T17:38:07,767   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-11-08T17:38:07,768   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-11-08T17:38:07,770   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-11-08T17:38:07,771   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-11-08T17:38:07,773   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-11-08T17:38:07,775   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-11-08T17:38:07,776   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-11-08T17:38:07,778   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-11-08T17:38:07,779   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-11-08T17:38:07,781   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-11-08T17:38:07,782   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-11-08T17:38:07,784   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-11-08T17:38:07,786   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-11-08T17:38:07,787   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-11-08T17:38:07,789   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-11-08T17:38:07,790   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-11-08T17:38:07,791   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-11-08T17:38:07,792   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-11-08T17:38:07,794   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-11-08T17:38:07,795   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-11-08T17:38:07,797   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-11-08T17:38:07,799   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-11-08T17:38:07,800   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-11-08T17:38:07,801   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-11-08T17:38:07,803   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-11-08T17:38:07,804   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-11-08T17:38:07,806   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-11-08T17:38:07,807   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-11-08T17:38:07,809   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-11-08T17:38:07,810   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-11-08T17:38:07,812   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-11-08T17:38:07,813   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-11-08T17:38:07,815   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-11-08T17:38:07,816   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-11-08T17:38:07,818   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-11-08T17:38:07,819   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-11-08T17:38:07,820   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-11-08T17:38:07,821   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-11-08T17:38:07,823   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-11-08T17:38:07,825   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-11-08T17:38:07,826   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-11-08T17:38:07,827   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-11-08T17:38:07,830   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-11-08T17:38:07,832   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-11-08T17:38:07,834   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-11-08T17:38:07,835   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-11-08T17:38:07,837   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-11-08T17:38:07,838   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-11-08T17:38:07,840   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-11-08T17:38:07,841   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-11-08T17:38:07,843   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-11-08T17:38:07,844   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-11-08T17:38:07,845   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-11-08T17:38:07,846   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-11-08T17:38:07,848   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-11-08T17:38:07,849   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-11-08T17:38:07,851   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-11-08T17:38:07,852   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-11-08T17:38:07,854   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-11-08T17:38:07,855   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-11-08T17:38:07,856   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-11-08T17:38:07,858   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-11-08T17:38:07,860   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-11-08T17:38:07,862   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-11-08T17:38:07,863   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-11-08T17:38:07,864   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-11-08T17:38:07,866   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-11-08T17:38:07,867   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-11-08T17:38:07,869   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-11-08T17:38:07,871   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-11-08T17:38:07,872   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-11-08T17:38:07,874   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-11-08T17:38:07,876   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-11-08T17:38:07,877   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-11-08T17:38:07,878   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-11-08T17:38:07,879   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-11-08T17:38:07,881   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-11-08T17:38:07,882   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-11-08T17:38:07,884   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-11-08T17:38:07,885   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-11-08T17:38:07,886   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-11-08T17:38:07,887   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-11-08T17:38:07,889   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-11-08T17:38:07,890   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-11-08T17:38:07,892   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-11-08T17:38:07,893   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-11-08T17:38:07,894   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-11-08T17:38:07,895   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-11-08T17:38:07,897   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-11-08T17:38:07,899   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-11-08T17:38:07,900   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-11-08T17:38:07,901   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-11-08T17:38:07,903   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-11-08T17:38:07,904   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-11-08T17:38:07,905   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-11-08T17:38:07,906   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-11-08T17:38:07,908   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-11-08T17:38:07,909   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-11-08T17:38:07,911   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-11-08T17:38:07,913   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-11-08T17:38:07,914   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-11-08T17:38:07,916   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-11-08T17:38:07,919   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-11-08T17:38:07,921   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-11-08T17:38:07,923   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-11-08T17:38:07,925   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-11-08T17:38:07,926   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-11-08T17:38:07,927   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-11-08T17:38:07,928   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-11-08T17:38:07,930   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-11-08T17:38:07,931   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-11-08T17:38:07,932   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-11-08T17:38:07,934   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-11-08T17:38:07,935   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-11-08T17:38:07,936   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-11-08T17:38:07,938   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-11-08T17:38:07,939   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-11-08T17:38:07,940   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-11-08T17:38:07,942   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-11-08T17:38:07,943   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-11-08T17:38:07,945   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-11-08T17:38:07,946   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-11-08T17:38:07,947   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-11-08T17:38:07,949   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-11-08T17:38:07,950   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-11-08T17:38:07,951   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-11-08T17:38:07,953   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-11-08T17:38:07,954   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-11-08T17:38:07,956   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-11-08T17:38:07,957   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-11-08T17:38:07,959   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-11-08T17:38:07,960   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-11-08T17:38:07,962   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-11-08T17:38:07,963   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-11-08T17:38:07,965   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-11-08T17:38:07,966   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-11-08T17:38:07,968   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-11-08T17:38:07,969   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-11-08T17:38:07,971   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-11-08T17:38:07,972   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-11-08T17:38:07,974   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-11-08T17:38:07,975   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-11-08T17:38:07,977   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-11-08T17:38:07,978   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-11-08T17:38:07,980   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-11-08T17:38:07,981   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-11-08T17:38:07,983   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-11-08T17:38:07,984   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-11-08T17:38:07,986   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-11-08T17:38:07,987   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-11-08T17:38:07,989   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-11-08T17:38:07,990   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-11-08T17:38:07,992   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-11-08T17:38:07,993   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-11-08T17:38:07,994   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-11-08T17:38:07,996   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-11-08T17:38:07,997   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-11-08T17:38:07,998   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-11-08T17:38:07,999   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-11-08T17:38:08,001   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-11-08T17:38:08,002   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-11-08T17:38:08,003   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-11-08T17:38:08,005   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-11-08T17:38:08,006   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-11-08T17:38:08,007   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-11-08T17:38:08,009   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-11-08T17:38:08,010   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-11-08T17:38:08,012   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-11-08T17:38:08,013   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-11-08T17:38:08,015   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-11-08T17:38:08,016   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-11-08T17:38:08,017   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-11-08T17:38:08,018   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-11-08T17:38:08,020   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-11-08T17:38:08,021   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-11-08T17:38:08,023   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-11-08T17:38:08,024   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-11-08T17:38:08,026   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-11-08T17:38:08,027   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-11-08T17:38:08,029   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-11-08T17:38:08,031   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-11-08T17:38:08,032   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-11-08T17:38:08,034   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-11-08T17:38:08,036   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-11-08T17:38:08,038   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-11-08T17:38:08,039   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-11-08T17:38:08,040   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-11-08T17:38:08,042   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-11-08T17:38:08,043   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-11-08T17:38:08,045   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-11-08T17:38:08,046   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-11-08T17:38:08,048   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-11-08T17:38:08,049   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-11-08T17:38:08,051   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-11-08T17:38:08,052   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-11-08T17:38:08,053   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-11-08T17:38:08,054   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-11-08T17:38:08,056   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-11-08T17:38:08,057   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-11-08T17:38:08,059   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-11-08T17:38:08,060   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-11-08T17:38:08,062   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-11-08T17:38:08,064   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-11-08T17:38:08,066   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-11-08T17:38:08,068   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-11-08T17:38:08,069   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-11-08T17:38:08,071   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-11-08T17:38:08,072   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-11-08T17:38:08,074   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-11-08T17:38:08,076   adding 'deepspeed/launcher/__init__.py'
2024-11-08T17:38:08,077   adding 'deepspeed/launcher/constants.py'
2024-11-08T17:38:08,079   adding 'deepspeed/launcher/launch.py'
2024-11-08T17:38:08,080   adding 'deepspeed/launcher/launcher_helper.py'
2024-11-08T17:38:08,082   adding 'deepspeed/launcher/multinode_runner.py'
2024-11-08T17:38:08,085   adding 'deepspeed/launcher/runner.py'
2024-11-08T17:38:08,087   adding 'deepspeed/linear/__init__.py'
2024-11-08T17:38:08,088   adding 'deepspeed/linear/config.py'
2024-11-08T17:38:08,090   adding 'deepspeed/linear/context_manager.py'
2024-11-08T17:38:08,091   adding 'deepspeed/linear/optimized_linear.py'
2024-11-08T17:38:08,093   adding 'deepspeed/linear/quantization.py'
2024-11-08T17:38:08,095   adding 'deepspeed/model_implementations/__init__.py'
2024-11-08T17:38:08,096   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-11-08T17:38:08,098   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-11-08T17:38:08,099   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-11-08T17:38:08,100   adding 'deepspeed/model_implementations/features/__init__.py'
2024-11-08T17:38:08,102   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-11-08T17:38:08,104   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-11-08T17:38:08,105   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-11-08T17:38:08,106   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-11-08T17:38:08,108   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-11-08T17:38:08,109   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-11-08T17:38:08,110   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-11-08T17:38:08,111   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-11-08T17:38:08,112   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-11-08T17:38:08,114   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-11-08T17:38:08,115   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-11-08T17:38:08,118   adding 'deepspeed/module_inject/__init__.py'
2024-11-08T17:38:08,121   adding 'deepspeed/module_inject/auto_tp.py'
2024-11-08T17:38:08,122   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-11-08T17:38:08,124   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-11-08T17:38:08,126   adding 'deepspeed/module_inject/inject.py'
2024-11-08T17:38:08,127   adding 'deepspeed/module_inject/layers.py'
2024-11-08T17:38:08,129   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-11-08T17:38:08,130   adding 'deepspeed/module_inject/module_quantize.py'
2024-11-08T17:38:08,132   adding 'deepspeed/module_inject/policy.py'
2024-11-08T17:38:08,135   adding 'deepspeed/module_inject/replace_module.py'
2024-11-08T17:38:08,136   adding 'deepspeed/module_inject/replace_policy.py'
2024-11-08T17:38:08,137   adding 'deepspeed/module_inject/tp_shard.py'
2024-11-08T17:38:08,139   adding 'deepspeed/module_inject/utils.py'
2024-11-08T17:38:08,140   adding 'deepspeed/module_inject/containers/__init__.py'
2024-11-08T17:38:08,142   adding 'deepspeed/module_inject/containers/base.py'
2024-11-08T17:38:08,144   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-11-08T17:38:08,145   adding 'deepspeed/module_inject/containers/bert.py'
2024-11-08T17:38:08,146   adding 'deepspeed/module_inject/containers/bloom.py'
2024-11-08T17:38:08,148   adding 'deepspeed/module_inject/containers/clip.py'
2024-11-08T17:38:08,149   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-11-08T17:38:08,150   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-11-08T17:38:08,152   adding 'deepspeed/module_inject/containers/gptj.py'
2024-11-08T17:38:08,153   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-11-08T17:38:08,155   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-11-08T17:38:08,156   adding 'deepspeed/module_inject/containers/internlm.py'
2024-11-08T17:38:08,158   adding 'deepspeed/module_inject/containers/llama.py'
2024-11-08T17:38:08,159   adding 'deepspeed/module_inject/containers/llama2.py'
2024-11-08T17:38:08,161   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-11-08T17:38:08,162   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-11-08T17:38:08,163   adding 'deepspeed/module_inject/containers/opt.py'
2024-11-08T17:38:08,165   adding 'deepspeed/module_inject/containers/unet.py'
2024-11-08T17:38:08,166   adding 'deepspeed/module_inject/containers/vae.py'
2024-11-08T17:38:08,168   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-11-08T17:38:08,169   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-11-08T17:38:08,171   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-11-08T17:38:08,172   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-11-08T17:38:08,173   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-11-08T17:38:08,175   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-11-08T17:38:08,176   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-11-08T17:38:08,178   adding 'deepspeed/moe/__init__.py'
2024-11-08T17:38:08,179   adding 'deepspeed/moe/experts.py'
2024-11-08T17:38:08,181   adding 'deepspeed/moe/layer.py'
2024-11-08T17:38:08,182   adding 'deepspeed/moe/mappings.py'
2024-11-08T17:38:08,185   adding 'deepspeed/moe/sharded_moe.py'
2024-11-08T17:38:08,187   adding 'deepspeed/moe/utils.py'
2024-11-08T17:38:08,189   adding 'deepspeed/monitor/__init__.py'
2024-11-08T17:38:08,190   adding 'deepspeed/monitor/comet.py'
2024-11-08T17:38:08,191   adding 'deepspeed/monitor/config.py'
2024-11-08T17:38:08,193   adding 'deepspeed/monitor/csv_monitor.py'
2024-11-08T17:38:08,194   adding 'deepspeed/monitor/monitor.py'
2024-11-08T17:38:08,195   adding 'deepspeed/monitor/tensorboard.py'
2024-11-08T17:38:08,196   adding 'deepspeed/monitor/utils.py'
2024-11-08T17:38:08,198   adding 'deepspeed/monitor/wandb.py'
2024-11-08T17:38:08,199   adding 'deepspeed/nebula/__init__.py'
2024-11-08T17:38:08,200   adding 'deepspeed/nebula/config.py'
2024-11-08T17:38:08,202   adding 'deepspeed/nebula/constants.py'
2024-11-08T17:38:08,203   adding 'deepspeed/nvme/__init__.py'
2024-11-08T17:38:08,205   adding 'deepspeed/nvme/ds_aio_args.py'
2024-11-08T17:38:08,206   adding 'deepspeed/nvme/ds_aio_basic.py'
2024-11-08T17:38:08,208   adding 'deepspeed/nvme/ds_aio_handle.py'
2024-11-08T17:38:08,209   adding 'deepspeed/nvme/ds_aio_job.py'
2024-11-08T17:38:08,210   adding 'deepspeed/nvme/parse_nvme_stats.py'
2024-11-08T17:38:08,211   adding 'deepspeed/nvme/perf_generate_param.py'
2024-11-08T17:38:08,213   adding 'deepspeed/nvme/perf_run_sweep.py'
2024-11-08T17:38:08,214   adding 'deepspeed/nvme/perf_sweep_utils.py'
2024-11-08T17:38:08,215   adding 'deepspeed/nvme/test_ds_aio.py'
2024-11-08T17:38:08,216   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2024-11-08T17:38:08,217   adding 'deepspeed/nvme/validate_async_io.py'
2024-11-08T17:38:08,219   adding 'deepspeed/ops/__init__.py'
2024-11-08T17:38:08,220   adding 'deepspeed/ops/adagrad/__init__.py'
2024-11-08T17:38:08,222   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-11-08T17:38:08,223   adding 'deepspeed/ops/adam/__init__.py'
2024-11-08T17:38:08,225   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-11-08T17:38:08,227   adding 'deepspeed/ops/adam/fused_adam.py'
2024-11-08T17:38:08,228   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-11-08T17:38:08,229   adding 'deepspeed/ops/aio/__init__.py'
2024-11-08T17:38:08,232   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-11-08T17:38:08,234   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-11-08T17:38:08,235   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-11-08T17:38:08,236   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-11-08T17:38:08,238   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-11-08T17:38:08,239   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-11-08T17:38:08,242   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-11-08T17:38:08,243   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-11-08T17:38:08,244   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-11-08T17:38:08,246   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-11-08T17:38:08,247   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-11-08T17:38:08,248   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-11-08T17:38:08,250   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2024-11-08T17:38:08,251   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2024-11-08T17:38:08,252   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-11-08T17:38:08,254   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-11-08T17:38:08,255   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2024-11-08T17:38:08,256   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2024-11-08T17:38:08,257   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-11-08T17:38:08,259   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-11-08T17:38:08,260   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-11-08T17:38:08,261   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-11-08T17:38:08,263   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-11-08T17:38:08,264   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-11-08T17:38:08,265   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-11-08T17:38:08,267   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-11-08T17:38:08,268   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2024-11-08T17:38:08,270   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2024-11-08T17:38:08,271   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-11-08T17:38:08,272   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-11-08T17:38:08,275   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-11-08T17:38:08,277   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-11-08T17:38:08,280   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-11-08T17:38:08,281   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-11-08T17:38:08,283   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-11-08T17:38:08,285   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-11-08T17:38:08,287   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-11-08T17:38:08,288   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-11-08T17:38:08,290   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-11-08T17:38:08,291   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-11-08T17:38:08,299   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-11-08T17:38:08,304   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-11-08T17:38:08,306   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-11-08T17:38:08,309   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-11-08T17:38:08,310   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-11-08T17:38:08,312   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-11-08T17:38:08,314   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-11-08T17:38:08,316   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-11-08T17:38:08,319   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-11-08T17:38:08,321   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-11-08T17:38:08,322   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-11-08T17:38:08,324   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-11-08T17:38:08,332   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-11-08T17:38:08,335   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-11-08T17:38:08,337   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-11-08T17:38:08,341   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-11-08T17:38:08,344   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-11-08T17:38:08,348   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-11-08T17:38:08,350   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-11-08T17:38:08,351   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-11-08T17:38:08,353   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-11-08T17:38:08,355   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-11-08T17:38:08,357   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-11-08T17:38:08,359   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-11-08T17:38:08,361   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-11-08T17:38:08,362   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-11-08T17:38:08,365   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2024-11-08T17:38:08,366   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2024-11-08T17:38:08,367   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2024-11-08T17:38:08,369   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2024-11-08T17:38:08,370   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2024-11-08T17:38:08,371   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2024-11-08T17:38:08,374   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-11-08T17:38:08,375   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-11-08T17:38:08,376   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-11-08T17:38:08,377   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-11-08T17:38:08,379   adding 'deepspeed/ops/csrc/includes/context.h'
2024-11-08T17:38:08,380   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-11-08T17:38:08,382   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-11-08T17:38:08,383   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-11-08T17:38:08,384   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-11-08T17:38:08,386   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-11-08T17:38:08,387   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-11-08T17:38:08,389   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-11-08T17:38:08,390   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-11-08T17:38:08,391   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-11-08T17:38:08,392   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-11-08T17:38:08,394   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-11-08T17:38:08,395   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-11-08T17:38:08,397   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-11-08T17:38:08,398   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-11-08T17:38:08,400   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-11-08T17:38:08,402   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-11-08T17:38:08,403   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-11-08T17:38:08,405   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-11-08T17:38:08,407   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-11-08T17:38:08,409   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-11-08T17:38:08,411   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-11-08T17:38:08,412   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-11-08T17:38:08,414   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-11-08T17:38:08,415   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-11-08T17:38:08,417   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-11-08T17:38:08,419   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-11-08T17:38:08,421   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-11-08T17:38:08,422   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-11-08T17:38:08,424   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-11-08T17:38:08,425   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-11-08T17:38:08,426   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-11-08T17:38:08,428   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-11-08T17:38:08,431   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-11-08T17:38:08,433   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-11-08T17:38:08,435   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-11-08T17:38:08,436   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-11-08T17:38:08,438   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-11-08T17:38:08,440   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-11-08T17:38:08,442   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-11-08T17:38:08,443   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-11-08T17:38:08,445   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-11-08T17:38:08,446   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-11-08T17:38:08,448   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-11-08T17:38:08,450   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-11-08T17:38:08,452   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-11-08T17:38:08,454   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-11-08T17:38:08,456   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-11-08T17:38:08,459   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-11-08T17:38:08,462   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-11-08T17:38:08,464   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-11-08T17:38:08,466   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-11-08T17:38:08,470   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-11-08T17:38:08,473   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-11-08T17:38:08,475   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-11-08T17:38:08,478   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-11-08T17:38:08,479   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-11-08T17:38:08,482   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-11-08T17:38:08,484   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-11-08T17:38:08,485   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-11-08T17:38:08,490   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-11-08T17:38:08,492   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-11-08T17:38:08,494   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-11-08T17:38:08,496   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-11-08T17:38:08,499   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-11-08T17:38:08,501   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-11-08T17:38:08,503   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-11-08T17:38:08,505   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-11-08T17:38:08,506   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-11-08T17:38:08,509   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-11-08T17:38:08,511   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-11-08T17:38:08,512   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-11-08T17:38:08,514   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-11-08T17:38:08,516   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-11-08T17:38:08,518   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-11-08T17:38:08,519   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-11-08T17:38:08,521   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-11-08T17:38:08,522   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-11-08T17:38:08,523   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-11-08T17:38:08,525   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-11-08T17:38:08,527   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-11-08T17:38:08,528   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-11-08T17:38:08,530   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-11-08T17:38:08,532   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-11-08T17:38:08,533   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-11-08T17:38:08,535   adding 'deepspeed/ops/gds/__init__.py'
2024-11-08T17:38:08,536   adding 'deepspeed/ops/lamb/__init__.py'
2024-11-08T17:38:08,538   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-11-08T17:38:08,540   adding 'deepspeed/ops/lion/__init__.py'
2024-11-08T17:38:08,541   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-11-08T17:38:08,543   adding 'deepspeed/ops/lion/fused_lion.py'
2024-11-08T17:38:08,544   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-11-08T17:38:08,546   adding 'deepspeed/ops/op_builder/__init__.py'
2024-11-08T17:38:08,548   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-11-08T17:38:08,549   adding 'deepspeed/ops/op_builder/async_io.py'
2024-11-08T17:38:08,553   adding 'deepspeed/ops/op_builder/builder.py'
2024-11-08T17:38:08,554   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-11-08T17:38:08,555   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-11-08T17:38:08,556   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-11-08T17:38:08,558   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-11-08T17:38:08,559   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-11-08T17:38:08,560   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-11-08T17:38:08,561   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-11-08T17:38:08,562   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-11-08T17:38:08,563   adding 'deepspeed/ops/op_builder/gds.py'
2024-11-08T17:38:08,565   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-11-08T17:38:08,566   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-11-08T17:38:08,567   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-11-08T17:38:08,568   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-11-08T17:38:08,570   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-11-08T17:38:08,571   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-11-08T17:38:08,572   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-11-08T17:38:08,573   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-11-08T17:38:08,575   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-11-08T17:38:08,576   adding 'deepspeed/ops/op_builder/transformer.py'
2024-11-08T17:38:08,577   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-11-08T17:38:08,579   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-11-08T17:38:08,580   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2024-11-08T17:38:08,581   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-11-08T17:38:08,583   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-11-08T17:38:08,584   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-11-08T17:38:08,585   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-11-08T17:38:08,586   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-11-08T17:38:08,588   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-11-08T17:38:08,589   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-11-08T17:38:08,591   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-11-08T17:38:08,592   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-11-08T17:38:08,593   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-11-08T17:38:08,595   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2024-11-08T17:38:08,596   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2024-11-08T17:38:08,598   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2024-11-08T17:38:08,599   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2024-11-08T17:38:08,600   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2024-11-08T17:38:08,601   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2024-11-08T17:38:08,602   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2024-11-08T17:38:08,604   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-11-08T17:38:08,606   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-11-08T17:38:08,607   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-11-08T17:38:08,608   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-11-08T17:38:08,609   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-11-08T17:38:08,610   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-11-08T17:38:08,612   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-11-08T17:38:08,614   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-11-08T17:38:08,615   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-11-08T17:38:08,617   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-11-08T17:38:08,618   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-11-08T17:38:08,620   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-11-08T17:38:08,621   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-11-08T17:38:08,622   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-11-08T17:38:08,623   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-11-08T17:38:08,624   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-11-08T17:38:08,626   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-11-08T17:38:08,627   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-11-08T17:38:08,628   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-11-08T17:38:08,629   adding 'deepspeed/ops/quantizer/__init__.py'
2024-11-08T17:38:08,630   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-11-08T17:38:08,632   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-11-08T17:38:08,633   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-11-08T17:38:08,635   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-11-08T17:38:08,636   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-11-08T17:38:08,640   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-11-08T17:38:08,642   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-11-08T17:38:08,644   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-11-08T17:38:08,646   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-11-08T17:38:08,649   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-11-08T17:38:08,650   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-11-08T17:38:08,652   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-11-08T17:38:08,653   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-11-08T17:38:08,655   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-11-08T17:38:08,656   adding 'deepspeed/ops/transformer/__init__.py'
2024-11-08T17:38:08,658   adding 'deepspeed/ops/transformer/transformer.py'
2024-11-08T17:38:08,660   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-11-08T17:38:08,661   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-11-08T17:38:08,663   adding 'deepspeed/ops/transformer/inference/config.py'
2024-11-08T17:38:08,664   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-11-08T17:38:08,666   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-11-08T17:38:08,667   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-11-08T17:38:08,669   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-11-08T17:38:08,671   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-11-08T17:38:08,673   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-11-08T17:38:08,674   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-11-08T17:38:08,677   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-11-08T17:38:08,678   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-11-08T17:38:08,679   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2024-11-08T17:38:08,680   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2024-11-08T17:38:08,682   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2024-11-08T17:38:08,683   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2024-11-08T17:38:08,684   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2024-11-08T17:38:08,685   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2024-11-08T17:38:08,687   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-11-08T17:38:08,688   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2024-11-08T17:38:08,689   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-11-08T17:38:08,691   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-11-08T17:38:08,692   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2024-11-08T17:38:08,693   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2024-11-08T17:38:08,695   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2024-11-08T17:38:08,696   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-11-08T17:38:08,697   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-11-08T17:38:08,699   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2024-11-08T17:38:08,700   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-11-08T17:38:08,702   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-11-08T17:38:08,703   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2024-11-08T17:38:08,704   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-11-08T17:38:08,706   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2024-11-08T17:38:08,707   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-11-08T17:38:08,709   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-11-08T17:38:08,710   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-11-08T17:38:08,712   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-11-08T17:38:08,714   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-11-08T17:38:08,715   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-11-08T17:38:08,717   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-11-08T17:38:08,718   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-11-08T17:38:08,719   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-11-08T17:38:08,721   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-11-08T17:38:08,723   adding 'deepspeed/pipe/__init__.py'
2024-11-08T17:38:08,724   adding 'deepspeed/profiling/__init__.py'
2024-11-08T17:38:08,725   adding 'deepspeed/profiling/config.py'
2024-11-08T17:38:08,727   adding 'deepspeed/profiling/constants.py'
2024-11-08T17:38:08,728   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-11-08T17:38:08,734   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-11-08T17:38:08,736   adding 'deepspeed/runtime/__init__.py'
2024-11-08T17:38:08,737   adding 'deepspeed/runtime/base_optimizer.py'
2024-11-08T17:38:08,740   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-11-08T17:38:08,742   adding 'deepspeed/runtime/compiler.py'
2024-11-08T17:38:08,746   adding 'deepspeed/runtime/config.py'
2024-11-08T17:38:08,748   adding 'deepspeed/runtime/config_utils.py'
2024-11-08T17:38:08,750   adding 'deepspeed/runtime/constants.py'
2024-11-08T17:38:08,751   adding 'deepspeed/runtime/dataloader.py'
2024-11-08T17:38:08,752   adding 'deepspeed/runtime/eigenvalue.py'
2024-11-08T17:38:08,771   adding 'deepspeed/runtime/engine.py'
2024-11-08T17:38:08,775   adding 'deepspeed/runtime/hybrid_engine.py'
2024-11-08T17:38:08,778   adding 'deepspeed/runtime/lr_schedules.py'
2024-11-08T17:38:08,780   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-11-08T17:38:08,782   adding 'deepspeed/runtime/quantize.py'
2024-11-08T17:38:08,783   adding 'deepspeed/runtime/sparse_tensor.py'
2024-11-08T17:38:08,785   adding 'deepspeed/runtime/state_dict_factory.py'
2024-11-08T17:38:08,790   adding 'deepspeed/runtime/utils.py'
2024-11-08T17:38:08,792   adding 'deepspeed/runtime/weight_quantizer.py'
2024-11-08T17:38:08,794   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-11-08T17:38:08,799   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-11-08T17:38:08,801   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-11-08T17:38:08,802   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-11-08T17:38:08,803   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-11-08T17:38:08,805   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-11-08T17:38:08,806   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-11-08T17:38:08,808   adding 'deepspeed/runtime/comm/__init__.py'
2024-11-08T17:38:08,809   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-11-08T17:38:08,811   adding 'deepspeed/runtime/comm/compressed.py'
2024-11-08T17:38:08,812   adding 'deepspeed/runtime/comm/hccl.py'
2024-11-08T17:38:08,814   adding 'deepspeed/runtime/comm/mpi.py'
2024-11-08T17:38:08,816   adding 'deepspeed/runtime/comm/nccl.py'
2024-11-08T17:38:08,817   adding 'deepspeed/runtime/compression/__init__.py'
2024-11-08T17:38:08,818   adding 'deepspeed/runtime/compression/cupy.py'
2024-11-08T17:38:08,820   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-11-08T17:38:08,821   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-11-08T17:38:08,823   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-11-08T17:38:08,824   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-11-08T17:38:08,826   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-11-08T17:38:08,827   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-11-08T17:38:08,828   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-11-08T17:38:08,830   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-11-08T17:38:08,831   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-11-08T17:38:08,832   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-11-08T17:38:08,837   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-11-08T17:38:08,840   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-11-08T17:38:08,843   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-11-08T17:38:08,844   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-11-08T17:38:08,846   adding 'deepspeed/runtime/fp16/__init__.py'
2024-11-08T17:38:08,848   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-11-08T17:38:08,850   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-11-08T17:38:08,853   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-11-08T17:38:08,854   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-11-08T17:38:08,857   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-11-08T17:38:08,859   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-11-08T17:38:08,862   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-11-08T17:38:08,863   adding 'deepspeed/runtime/pipe/__init__.py'
2024-11-08T17:38:08,870   adding 'deepspeed/runtime/pipe/engine.py'
2024-11-08T17:38:08,874   adding 'deepspeed/runtime/pipe/module.py'
2024-11-08T17:38:08,876   adding 'deepspeed/runtime/pipe/p2p.py'
2024-11-08T17:38:08,878   adding 'deepspeed/runtime/pipe/schedule.py'
2024-11-08T17:38:08,880   adding 'deepspeed/runtime/pipe/topology.py'
2024-11-08T17:38:08,882   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-11-08T17:38:08,883   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-11-08T17:38:08,885   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-11-08T17:38:08,886   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-11-08T17:38:08,888   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-11-08T17:38:08,890   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-11-08T17:38:08,893   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-11-08T17:38:08,895   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-11-08T17:38:08,896   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-11-08T17:38:08,898   adding 'deepspeed/runtime/zero/__init__.py'
2024-11-08T17:38:08,900   adding 'deepspeed/runtime/zero/config.py'
2024-11-08T17:38:08,902   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-11-08T17:38:08,904   adding 'deepspeed/runtime/zero/linear.py'
2024-11-08T17:38:08,907   adding 'deepspeed/runtime/zero/mics.py'
2024-11-08T17:38:08,908   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-11-08T17:38:08,910   adding 'deepspeed/runtime/zero/offload_config.py'
2024-11-08T17:38:08,911   adding 'deepspeed/runtime/zero/offload_states.py'
2024-11-08T17:38:08,914   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-11-08T17:38:08,925   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-11-08T17:38:08,929   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-11-08T17:38:08,930   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-11-08T17:38:08,946   adding 'deepspeed/runtime/zero/stage3.py'
2024-11-08T17:38:08,961   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-11-08T17:38:08,962   adding 'deepspeed/runtime/zero/test.py'
2024-11-08T17:38:08,964   adding 'deepspeed/runtime/zero/tiling.py'
2024-11-08T17:38:08,966   adding 'deepspeed/runtime/zero/utils.py'
2024-11-08T17:38:08,968   adding 'deepspeed/sequence/__init__.py'
2024-11-08T17:38:08,969   adding 'deepspeed/sequence/cross_entropy.py'
2024-11-08T17:38:08,971   adding 'deepspeed/sequence/layer.py'
2024-11-08T17:38:08,973   adding 'deepspeed/utils/__init__.py'
2024-11-08T17:38:08,974   adding 'deepspeed/utils/bwc.py'
2024-11-08T17:38:08,975   adding 'deepspeed/utils/comms_logging.py'
2024-11-08T17:38:08,977   adding 'deepspeed/utils/config.py'
2024-11-08T17:38:08,978   adding 'deepspeed/utils/debug.py'
2024-11-08T17:38:08,979   adding 'deepspeed/utils/exceptions.py'
2024-11-08T17:38:08,982   adding 'deepspeed/utils/groups.py'
2024-11-08T17:38:08,983   adding 'deepspeed/utils/init_on_device.py'
2024-11-08T17:38:08,985   adding 'deepspeed/utils/logging.py'
2024-11-08T17:38:08,986   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-11-08T17:38:08,988   adding 'deepspeed/utils/numa.py'
2024-11-08T17:38:08,989   adding 'deepspeed/utils/nvtx.py'
2024-11-08T17:38:08,991   adding 'deepspeed/utils/tensor_fragment.py'
2024-11-08T17:38:08,992   adding 'deepspeed/utils/timer.py'
2024-11-08T17:38:08,994   adding 'deepspeed/utils/torch.py'
2024-11-08T17:38:08,995   adding 'deepspeed/utils/types.py'
2024-11-08T17:38:08,996   adding 'deepspeed/utils/z3_leaf_module.py'
2024-11-08T17:38:08,999   adding 'deepspeed/utils/zero_to_fp32.py'
2024-11-08T17:38:09,002   adding 'deepspeed-0.15.4.data/scripts/deepspeed'
2024-11-08T17:38:09,003   adding 'deepspeed-0.15.4.data/scripts/deepspeed.pt'
2024-11-08T17:38:09,004   adding 'deepspeed-0.15.4.data/scripts/ds'
2024-11-08T17:38:09,005   adding 'deepspeed-0.15.4.data/scripts/ds_bench'
2024-11-08T17:38:09,006   adding 'deepspeed-0.15.4.data/scripts/ds_elastic'
2024-11-08T17:38:09,007   adding 'deepspeed-0.15.4.data/scripts/ds_io'
2024-11-08T17:38:09,009   adding 'deepspeed-0.15.4.data/scripts/ds_nvme_tune'
2024-11-08T17:38:09,010   adding 'deepspeed-0.15.4.data/scripts/ds_report'
2024-11-08T17:38:09,011   adding 'deepspeed-0.15.4.data/scripts/ds_ssh'
2024-11-08T17:38:09,012   adding 'deepspeed-0.15.4.data/scripts/dsr'
2024-11-08T17:38:09,015   adding 'deepspeed-0.15.4.dist-info/LICENSE'
2024-11-08T17:38:09,020   adding 'deepspeed-0.15.4.dist-info/METADATA'
2024-11-08T17:38:09,021   adding 'deepspeed-0.15.4.dist-info/WHEEL'
2024-11-08T17:38:09,022   adding 'deepspeed-0.15.4.dist-info/entry_points.txt'
2024-11-08T17:38:09,023   adding 'deepspeed-0.15.4.dist-info/top_level.txt'
2024-11-08T17:38:09,038   adding 'deepspeed-0.15.4.dist-info/RECORD'
2024-11-08T17:38:09,063   removing build/bdist.linux-armv7l/wheel
2024-11-08T17:38:09,284   deepspeed build time = 11.871397733688354 secs
2024-11-08T17:38:09,406   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-11-08T17:38:09,424   Created wheel for deepspeed: filename=deepspeed-0.15.4-py3-none-any.whl size=1527810 sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378
2024-11-08T17:38:09,425   Stored in directory: /tmp/pip-ephem-wheel-cache-9suhymio/wheels/9f/b7/07/035dfeaae31b5766822083a749891e45aab9c72d25a78b7dd0
2024-11-08T17:38:09,469 Successfully built deepspeed
2024-11-08T17:38:09,509 Removed build tracker: '/tmp/pip-build-tracker-arpwu239'