2024-11-29T05:57:45,730 Created temporary directory: /tmp/pip-build-tracker-i5n9x_rw
2024-11-29T05:57:45,731 Initialized build tracking at /tmp/pip-build-tracker-i5n9x_rw
2024-11-29T05:57:45,731 Created build tracker: /tmp/pip-build-tracker-i5n9x_rw
2024-11-29T05:57:45,732 Entered build tracker: /tmp/pip-build-tracker-i5n9x_rw
2024-11-29T05:57:45,733 Created temporary directory: /tmp/pip-wheel-1u0lbmaj
2024-11-29T05:57:45,737 Created temporary directory: /tmp/pip-ephem-wheel-cache-ro9chzv8
2024-11-29T05:57:45,781 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-11-29T05:57:45,783 2 location(s) to search for versions of deepspeed:
2024-11-29T05:57:45,783 * https://pypi.org/simple/deepspeed/
2024-11-29T05:57:45,783 * https://www.piwheels.org/simple/deepspeed/
2024-11-29T05:57:45,784 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-11-29T05:57:45,785 Getting page https://pypi.org/simple/deepspeed/
2024-11-29T05:57:45,786 Found index url https://pypi.org/simple/
2024-11-29T05:57:46,007 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-11-29T05:57:46,026   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-29T05:57:46,027   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-11-29T05:57:46,028   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-29T05:57:46,028   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-11-29T05:57:46,029   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-29T05:57:46,030   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-11-29T05:57:46,030   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-29T05:57:46,031   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-11-29T05:57:46,031   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-11-29T05:57:46,032   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-11-29T05:57:46,033   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-11-29T05:57:46,033   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-11-29T05:57:46,034   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-11-29T05:57:46,035   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-11-29T05:57:46,036   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-11-29T05:57:46,036   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-11-29T05:57:46,037   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-11-29T05:57:46,037   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-11-29T05:57:46,038   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-11-29T05:57:46,038   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-11-29T05:57:46,039   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-11-29T05:57:46,040   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-11-29T05:57:46,040   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-11-29T05:57:46,041   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-11-29T05:57:46,041   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-11-29T05:57:46,042   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-11-29T05:57:46,043   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-11-29T05:57:46,043   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-11-29T05:57:46,044   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-11-29T05:57:46,044   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-11-29T05:57:46,045   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-11-29T05:57:46,046   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-11-29T05:57:46,047   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-11-29T05:57:46,047   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-11-29T05:57:46,048   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-11-29T05:57:46,048   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-11-29T05:57:46,049   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-11-29T05:57:46,049   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-11-29T05:57:46,050   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-11-29T05:57:46,050   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-11-29T05:57:46,051   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-11-29T05:57:46,052   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-11-29T05:57:46,052   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-11-29T05:57:46,053   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-11-29T05:57:46,053   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-11-29T05:57:46,054   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-11-29T05:57:46,055   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-11-29T05:57:46,055   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-11-29T05:57:46,056   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-11-29T05:57:46,056   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-11-29T05:57:46,057   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-11-29T05:57:46,058   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-11-29T05:57:46,058   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-11-29T05:57:46,059   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-11-29T05:57:46,060   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-11-29T05:57:46,060   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-11-29T05:57:46,061   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-11-29T05:57:46,061   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-11-29T05:57:46,062   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-11-29T05:57:46,063   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-11-29T05:57:46,063   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-11-29T05:57:46,064   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-11-29T05:57:46,065   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-11-29T05:57:46,066   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-11-29T05:57:46,067   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-11-29T05:57:46,067   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-11-29T05:57:46,068   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-11-29T05:57:46,069   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-11-29T05:57:46,070   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-11-29T05:57:46,070   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-11-29T05:57:46,071   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-11-29T05:57:46,071   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-11-29T05:57:46,072   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-11-29T05:57:46,072   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-11-29T05:57:46,073   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-11-29T05:57:46,074   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-11-29T05:57:46,075   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-11-29T05:57:46,075   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-11-29T05:57:46,076   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-11-29T05:57:46,076   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-11-29T05:57:46,077   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-11-29T05:57:46,078   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-11-29T05:57:46,078   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-11-29T05:57:46,079   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-11-29T05:57:46,080   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-11-29T05:57:46,080   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-11-29T05:57:46,081   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-11-29T05:57:46,082   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-11-29T05:57:46,083   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-11-29T05:57:46,083   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-11-29T05:57:46,084   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-11-29T05:57:46,084   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-11-29T05:57:46,085   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-11-29T05:57:46,085   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-11-29T05:57:46,086   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-11-29T05:57:46,087   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-11-29T05:57:46,087   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-11-29T05:57:46,088   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-11-29T05:57:46,088   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-11-29T05:57:46,089   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2024-11-29T05:57:46,089   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2024-11-29T05:57:46,090   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2024-11-29T05:57:46,091   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2024-11-29T05:57:46,091   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2024-11-29T05:57:46,092   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2024-11-29T05:57:46,093 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-11-29T05:57:46,093 Getting page https://www.piwheels.org/simple/deepspeed/
2024-11-29T05:57:46,095 Found index url https://www.piwheels.org/simple/
2024-11-29T05:57:46,268 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-11-29T05:57:46,286   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,287   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,288   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,288   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,289   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,289   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,290   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,290   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,291   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,291   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,292   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,293   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,293   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,294   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,294   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,295   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,295   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,296   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,296   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,297   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,297   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,298   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,298   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,299   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,299   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,300   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,300   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,301   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,302   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,303   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,303   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,304   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,304   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,305   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,305   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,306   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,306   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,307   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,307   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,308   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,308   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,309   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,310   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,310   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,311   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,311   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,312   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,312   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,313   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,313   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,314   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,314   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,315   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,315   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,316   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,316   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,317   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,318   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,318   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,319   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,319   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,320   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,320   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,321   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,322   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,322   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,323   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,323   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,324   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,324   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,325   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,326   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-11-29T05:57:46,326 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-11-29T05:57:46,327 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-11-29T05:57:46,357 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-11-29T05:57:46,359 Collecting deepspeed==0.16.0
2024-11-29T05:57:46,362   Created temporary directory: /tmp/pip-unpack-gaxd_97s
2024-11-29T05:57:46,503   Downloading deepspeed-0.16.0.tar.gz (1.4 MB)
2024-11-29T05:57:49,123   Added deepspeed==0.16.0 from https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz to build tracker '/tmp/pip-build-tracker-i5n9x_rw'
2024-11-29T05:57:49,125   Running setup.py (path:/tmp/pip-wheel-1u0lbmaj/deepspeed_6ef741316d8e4dca8f5b30fd8e1e9e86/setup.py) egg_info for package deepspeed
2024-11-29T05:57:49,126   Created temporary directory: /tmp/pip-pip-egg-info-vu3rg04a
2024-11-29T05:57:49,126   Preparing metadata (setup.py): started
2024-11-29T05:57:49,128   Running command python setup.py egg_info
2024-11-29T05:57:50,111   fatal: not a git repository (or any of the parent directories): .git
2024-11-29T05:57:50,791   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-11-29T05:57:50,792    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-11-29T05:57:50,792   DS_BUILD_OPS=0
2024-11-29T05:57:50,793   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-11-29T05:57:50,793   version=0.16.0, git_hash=unknown, git_branch=unknown
2024-11-29T05:57:50,794   install_requires=['hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-11-29T05:57:50,794   ext_modules=[]
2024-11-29T05:57:50,795   running egg_info
2024-11-29T05:57:50,819   creating /tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info
2024-11-29T05:57:50,821   writing /tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info/PKG-INFO
2024-11-29T05:57:50,854   writing dependency_links to /tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info/dependency_links.txt
2024-11-29T05:57:50,856   writing entry points to /tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info/entry_points.txt
2024-11-29T05:57:50,874   writing requirements to /tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info/requires.txt
2024-11-29T05:57:50,875   writing top-level names to /tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info/top_level.txt
2024-11-29T05:57:50,877   writing manifest file '/tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info/SOURCES.txt'
2024-11-29T05:57:51,128   reading manifest file '/tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info/SOURCES.txt'
2024-11-29T05:57:51,130   reading manifest template 'MANIFEST.in'
2024-11-29T05:57:51,132   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-11-29T05:57:51,133   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-11-29T05:57:52,811   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-11-29T05:57:53,934   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-11-29T05:57:54,811   warning: no files found matching '*.tr' under directory 'csrc'
2024-11-29T05:57:54,942   warning: no files found matching '*.cc' under directory 'csrc'
2024-11-29T05:57:54,991   warning: no files found matching '*.py' under directory 'benchmarks'
2024-11-29T05:57:54,997   adding license file 'LICENSE'
2024-11-29T05:57:55,036   writing manifest file '/tmp/pip-pip-egg-info-vu3rg04a/deepspeed.egg-info/SOURCES.txt'
2024-11-29T05:57:55,038   deepspeed build time = 4.923089027404785 secs
2024-11-29T05:57:55,152   Preparing metadata (setup.py): finished with status 'done'
2024-11-29T05:57:55,158   Source in /tmp/pip-wheel-1u0lbmaj/deepspeed_6ef741316d8e4dca8f5b30fd8e1e9e86 has version 0.16.0, which satisfies requirement deepspeed==0.16.0 from https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz
2024-11-29T05:57:55,159   Removed deepspeed==0.16.0 from https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz from build tracker '/tmp/pip-build-tracker-i5n9x_rw'
2024-11-29T05:57:55,231 Created temporary directory: /tmp/pip-unpack-0memnh7p
2024-11-29T05:57:55,232 Created temporary directory: /tmp/pip-unpack-pkiw5_es
2024-11-29T05:57:55,232 Building wheels for collected packages: deepspeed
2024-11-29T05:57:55,236   Created temporary directory: /tmp/pip-wheel-a2moo2n5
2024-11-29T05:57:55,237   Building wheel for deepspeed (setup.py): started
2024-11-29T05:57:55,238   Destination directory: /tmp/pip-wheel-a2moo2n5
2024-11-29T05:57:55,238   Running command python setup.py bdist_wheel
2024-11-29T05:57:55,708   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-11-29T05:57:55,713    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-11-29T05:57:55,811   DS_BUILD_OPS=0
2024-11-29T05:57:55,935   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'transformer_inference': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-11-29T05:57:55,954   fatal: not a git repository (or any of the parent directories): .git
2024-11-29T05:57:55,955   version=0.16.0, git_hash=unknown, git_branch=unknown
2024-11-29T05:57:55,956   install_requires=['hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-11-29T05:57:55,957   ext_modules=[]
2024-11-29T05:57:56,545   running bdist_wheel
2024-11-29T05:57:56,678   running build
2024-11-29T05:57:56,678   running build_py
2024-11-29T05:57:56,709   creating build/lib/deepspeed
2024-11-29T05:57:56,711   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-11-29T05:57:56,714   copying deepspeed/constants.py -> build/lib/deepspeed
2024-11-29T05:57:56,716   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-11-29T05:57:56,718   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-11-29T05:57:56,720   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-11-29T05:57:56,723   creating build/lib/deepspeed/launcher
2024-11-29T05:57:56,724   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-11-29T05:57:56,726   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-11-29T05:57:56,729   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-11-29T05:57:56,732   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-11-29T05:57:56,734   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-11-29T05:57:56,736   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-11-29T05:57:56,739   creating build/lib/deepspeed/model_implementations
2024-11-29T05:57:56,740   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-11-29T05:57:56,742   creating build/lib/deepspeed/elasticity
2024-11-29T05:57:56,743   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-11-29T05:57:56,746   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-11-29T05:57:56,747   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-11-29T05:57:56,749   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-11-29T05:57:56,752   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-11-29T05:57:56,755   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-11-29T05:57:56,758   creating build/lib/deepspeed/inference
2024-11-29T05:57:56,759   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-11-29T05:57:56,762   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-11-29T05:57:56,764   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-11-29T05:57:56,767   creating build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,768   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,771   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,773   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,776   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,778   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,780   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,783   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,785   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,787   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,788   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-11-29T05:57:56,791   creating build/lib/deepspeed/runtime
2024-11-29T05:57:56,792   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,794   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,797   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,799   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,802   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,804   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,810   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,812   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,815   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,817   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,819   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,821   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,822   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,825   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,827   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,830   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,833   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,836   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-11-29T05:57:56,838   creating build/lib/deepspeed/nebula
2024-11-29T05:57:56,839   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-11-29T05:57:56,841   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-11-29T05:57:56,843   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-11-29T05:57:56,845   creating build/lib/deepspeed/linear
2024-11-29T05:57:56,846   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-11-29T05:57:56,849   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-11-29T05:57:56,851   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-11-29T05:57:56,853   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-11-29T05:57:56,855   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-11-29T05:57:56,857   creating build/lib/deepspeed/nvme
2024-11-29T05:57:56,858   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,861   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,863   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,865   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,867   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,868   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,870   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,872   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,874   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,876   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,878   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,880   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2024-11-29T05:57:56,883   creating build/lib/deepspeed/autotuning
2024-11-29T05:57:56,884   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-11-29T05:57:56,888   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-11-29T05:57:56,893   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-11-29T05:57:56,898   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-11-29T05:57:56,901   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-11-29T05:57:56,904   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-11-29T05:57:56,907   creating build/lib/deepspeed/compression
2024-11-29T05:57:56,908   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-11-29T05:57:56,910   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-11-29T05:57:56,912   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-11-29T05:57:56,915   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-11-29T05:57:56,918   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-11-29T05:57:56,920   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-11-29T05:57:56,923   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-11-29T05:57:56,925   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-11-29T05:57:56,928   creating build/lib/deepspeed/profiling
2024-11-29T05:57:56,929   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-11-29T05:57:56,931   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-11-29T05:57:56,933   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-11-29T05:57:56,936   creating build/lib/deepspeed/utils
2024-11-29T05:57:56,937   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,939   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,942   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,944   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,946   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,948   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,949   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,952   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,954   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,957   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,959   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,961   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,963   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,965   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,967   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,969   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,971   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,973   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-11-29T05:57:56,975   creating build/lib/deepspeed/ops
2024-11-29T05:57:56,976   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-11-29T05:57:56,978   creating build/lib/deepspeed/sequence
2024-11-29T05:57:56,979   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-11-29T05:57:56,982   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-11-29T05:57:56,983   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2024-11-29T05:57:56,986   creating build/lib/deepspeed/moe
2024-11-29T05:57:56,987   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-11-29T05:57:56,989   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-11-29T05:57:56,991   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-11-29T05:57:56,993   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-11-29T05:57:56,996   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-11-29T05:57:56,998   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-11-29T05:57:57,000   creating build/lib/deepspeed/pipe
2024-11-29T05:57:57,002   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-11-29T05:57:57,004   creating build/lib/deepspeed/accelerator
2024-11-29T05:57:57,005   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,007   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,010   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,012   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,014   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,016   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,019   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,021   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,023   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,025   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-11-29T05:57:57,028   creating build/lib/deepspeed/monitor
2024-11-29T05:57:57,029   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-11-29T05:57:57,031   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-11-29T05:57:57,033   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-11-29T05:57:57,035   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-11-29T05:57:57,037   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-11-29T05:57:57,039   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-11-29T05:57:57,040   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-11-29T05:57:57,043   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-11-29T05:57:57,045   creating build/lib/deepspeed/comm
2024-11-29T05:57:57,046   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,048   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,051   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,052   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,054   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,056   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,058   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,060   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,062   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-11-29T05:57:57,065   creating build/lib/deepspeed/module_inject
2024-11-29T05:57:57,066   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,068   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,070   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,072   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,075   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,077   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,079   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,082   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,084   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,086   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,088   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,091   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,093   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-11-29T05:57:57,095   creating build/lib/deepspeed/model_implementations/features
2024-11-29T05:57:57,097   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-11-29T05:57:57,099   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-11-29T05:57:57,101   creating build/lib/deepspeed/model_implementations/diffusers
2024-11-29T05:57:57,102   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-11-29T05:57:57,105   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-11-29T05:57:57,107   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-11-29T05:57:57,109   creating build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,111   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,113   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,115   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,117   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,119   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,121   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,123   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,125   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,127   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,129   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-11-29T05:57:57,131   creating build/lib/deepspeed/inference/quantization
2024-11-29T05:57:57,132   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-11-29T05:57:57,135   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-11-29T05:57:57,137   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-11-29T05:57:57,139   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-11-29T05:57:57,141   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-11-29T05:57:57,144   creating build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,145   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,147   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,150   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,151   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,154   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,156   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,158   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,160   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,162   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-11-29T05:57:57,165   creating build/lib/deepspeed/inference/v2/model_implementations
2024-11-29T05:57:57,166   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-29T05:57:57,169   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-29T05:57:57,172   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-29T05:57:57,175   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-29T05:57:57,177   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-29T05:57:57,180   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-29T05:57:57,184   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-11-29T05:57:57,187   creating build/lib/deepspeed/inference/v2/checkpoint
2024-11-29T05:57:57,188   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-11-29T05:57:57,191   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-11-29T05:57:57,193   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-11-29T05:57:57,195   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-11-29T05:57:57,197   creating build/lib/deepspeed/inference/v2/ragged
2024-11-29T05:57:57,199   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-29T05:57:57,202   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-29T05:57:57,204   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-29T05:57:57,207   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-29T05:57:57,209   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-29T05:57:57,211   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-29T05:57:57,213   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-11-29T05:57:57,216   creating build/lib/deepspeed/inference/v2/kernels
2024-11-29T05:57:57,217   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-11-29T05:57:57,219   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-11-29T05:57:57,222   creating build/lib/deepspeed/inference/v2/modules
2024-11-29T05:57:57,223   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-11-29T05:57:57,226   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-11-29T05:57:57,228   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-11-29T05:57:57,230   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-11-29T05:57:57,232   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:57:57,234   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:57:57,236   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:57:57,238   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:57:57,240   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:57:57,243   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:57:57,244   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:57:57,246   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:57:57,249   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:57:57,251   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:57:57,253   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:57:57,254   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:57:57,257   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:57:57,259   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:57:57,261   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:57:57,263   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:57:57,264   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:57:57,266   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:57:57,269   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:57:57,271   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:57:57,273   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,275   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,277   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,279   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,281   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,284   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,285   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,288   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,290   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,292   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:57:57,294   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:57:57,296   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:57:57,298   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:57:57,300   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:57:57,302   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:57:57,305   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:57:57,306   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:57:57,308   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:57:57,310   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:57:57,312   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:57:57,314   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:57:57,315   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:57:57,318   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:57:57,320   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:57:57,322   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:57:57,324   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:57:57,326   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:57:57,328   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:57:57,330   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:57:57,332   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:57:57,335   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,336   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,338   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,340   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,343   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,345   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,347   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,349   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,351   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,353   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:57:57,356   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:57:57,357   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:57:57,359   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:57:57,362   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:57:57,364   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:57:57,366   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:57:57,368   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:57:57,370   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:57:57,372   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:57:57,374   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:57:57,376   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-11-29T05:57:57,378   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-11-29T05:57:57,380   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-11-29T05:57:57,381   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-11-29T05:57:57,384   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-11-29T05:57:57,385   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-11-29T05:57:57,388   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:57:57,389   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:57:57,391   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:57:57,393   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:57:57,395   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:57:57,396   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:57:57,398   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:57:57,401   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:57:57,402   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:57:57,405   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:57:57,407   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:57:57,409   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:57:57,411   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:57:57,413   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:57:57,415   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:57:57,417   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:57:57,418   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:57:57,420   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:57:57,423   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:57:57,424   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:57:57,426   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:57:57,428   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:57:57,430   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:57:57,432   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:57:57,434   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:57:57,435   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:57:57,437   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:57:57,440   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:57:57,441   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:57:57,443   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:57:57,446   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:57:57,447   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:57:57,449   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:57:57,452   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:57:57,453   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:57:57,455   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:57:57,458   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:57:57,459   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:57:57,461   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:57:57,464   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:57:57,465   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:57:57,467   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:57:57,469   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:57:57,471   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:57:57,473   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:57:57,475   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:57:57,477   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:57:57,479   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:57:57,480   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:57:57,482   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:57:57,485   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:57:57,486   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:57:57,488   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:57:57,490   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:57:57,492   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:57:57,494   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:57:57,496   creating build/lib/deepspeed/inference/v2/modules/configs
2024-11-29T05:57:57,497   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-29T05:57:57,500   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-29T05:57:57,502   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-29T05:57:57,504   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-29T05:57:57,506   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-29T05:57:57,508   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-29T05:57:57,509   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-11-29T05:57:57,512   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,513   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,515   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,518   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,520   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,522   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,524   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,525   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,527   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:57:57,529   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-11-29T05:57:57,530   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-11-29T05:57:57,533   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-11-29T05:57:57,534   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-11-29T05:57:57,536   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-11-29T05:57:57,538   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-11-29T05:57:57,541   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-11-29T05:57:57,542   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-11-29T05:57:57,544   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-11-29T05:57:57,546   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-11-29T05:57:57,547   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-11-29T05:57:57,550   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-11-29T05:57:57,552   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-11-29T05:57:57,553   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-11-29T05:57:57,556   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-11-29T05:57:57,558   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-11-29T05:57:57,560   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-11-29T05:57:57,562   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-11-29T05:57:57,564   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-11-29T05:57:57,566   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-11-29T05:57:57,568   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-11-29T05:57:57,571   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-29T05:57:57,572   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-29T05:57:57,574   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-29T05:57:57,576   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-29T05:57:57,579   creating build/lib/deepspeed/runtime/domino
2024-11-29T05:57:57,580   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2024-11-29T05:57:57,582   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2024-11-29T05:57:57,584   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-11-29T05:57:57,586   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-11-29T05:57:57,588   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-11-29T05:57:57,591   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-11-29T05:57:57,593   creating build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,594   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,597   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,601   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,604   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,608   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,610   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,615   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,617   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,619   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,622   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,623   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,626   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,629   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,631   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,634   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,636   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,638   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-11-29T05:57:57,642   creating build/lib/deepspeed/runtime/compression
2024-11-29T05:57:57,643   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-11-29T05:57:57,645   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-11-29T05:57:57,647   creating build/lib/deepspeed/runtime/data_pipeline
2024-11-29T05:57:57,648   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-11-29T05:57:57,651   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-11-29T05:57:57,654   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-11-29T05:57:57,656   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-11-29T05:57:57,658   creating build/lib/deepspeed/runtime/fp16
2024-11-29T05:57:57,660   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-11-29T05:57:57,662   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-11-29T05:57:57,665   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-11-29T05:57:57,668   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-11-29T05:57:57,671   creating build/lib/deepspeed/runtime/pipe
2024-11-29T05:57:57,672   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-11-29T05:57:57,676   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-11-29T05:57:57,685   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-11-29T05:57:57,696   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-11-29T05:57:57,707   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-11-29T05:57:57,717   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-11-29T05:57:57,720   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-11-29T05:57:57,721   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-11-29T05:57:57,724   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-11-29T05:57:57,726   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-11-29T05:57:57,728   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-11-29T05:57:57,731   creating build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,733   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,736   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,739   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,741   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,743   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,746   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,748   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,751   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,754   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-11-29T05:57:57,757   creating build/lib/deepspeed/runtime/comm
2024-11-29T05:57:57,758   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-11-29T05:57:57,761   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-11-29T05:57:57,764   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-11-29T05:57:57,767   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-11-29T05:57:57,769   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-11-29T05:57:57,772   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-11-29T05:57:57,775   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:57:57,776   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:57:57,779   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:57:57,782   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:57:57,784   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:57:57,786   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:57:57,790   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:57:57,791   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:57:57,800   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:57:57,802   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:57:57,805   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:57:57,807   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:57:57,810   creating build/lib/deepspeed/runtime/fp16/onebit
2024-11-29T05:57:57,812   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-11-29T05:57:57,815   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-11-29T05:57:57,818   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-11-29T05:57:57,820   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-11-29T05:57:57,823   creating build/lib/deepspeed/autotuning/tuner
2024-11-29T05:57:57,825   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-11-29T05:57:57,827   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-11-29T05:57:57,830   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-11-29T05:57:57,832   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-11-29T05:57:57,835   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-11-29T05:57:57,837   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-11-29T05:57:57,840   creating build/lib/deepspeed/profiling/flops_profiler
2024-11-29T05:57:57,841   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-11-29T05:57:57,843   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-11-29T05:57:57,847   creating build/lib/deepspeed/ops/deepspeed4science
2024-11-29T05:57:57,849   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-11-29T05:57:57,851   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-11-29T05:57:57,854   creating build/lib/deepspeed/ops/sparse_attention
2024-11-29T05:57:57,856   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-29T05:57:57,859   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-29T05:57:57,862   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-29T05:57:57,864   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-29T05:57:57,867   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-29T05:57:57,870   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-29T05:57:57,873   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-11-29T05:57:57,877   creating build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,879   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,883   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,886   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,888   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,891   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,894   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,897   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,900   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,902   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,905   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,908   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,910   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,912   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,915   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,917   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,920   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,922   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,925   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,927   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,930   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,932   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,935   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,938   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,940   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-11-29T05:57:57,944   creating build/lib/deepspeed/ops/quantizer
2024-11-29T05:57:57,945   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-11-29T05:57:57,948   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-11-29T05:57:57,951   creating build/lib/deepspeed/ops/aio
2024-11-29T05:57:57,952   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-11-29T05:57:57,956   creating build/lib/deepspeed/ops/adam
2024-11-29T05:57:57,958   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-11-29T05:57:57,960   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-11-29T05:57:57,964   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-11-29T05:57:57,967   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-11-29T05:57:57,970   creating build/lib/deepspeed/ops/fp_quantizer
2024-11-29T05:57:57,971   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-11-29T05:57:57,974   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-11-29T05:57:57,976   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-11-29T05:57:57,980   creating build/lib/deepspeed/ops/adagrad
2024-11-29T05:57:57,981   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-11-29T05:57:57,983   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-11-29T05:57:57,986   creating build/lib/deepspeed/ops/lamb
2024-11-29T05:57:57,987   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-11-29T05:57:57,989   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-11-29T05:57:57,991   creating build/lib/deepspeed/ops/gds
2024-11-29T05:57:57,993   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2024-11-29T05:57:57,995   creating build/lib/deepspeed/ops/lion
2024-11-29T05:57:57,996   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-11-29T05:57:57,999   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-11-29T05:57:58,001   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-11-29T05:57:58,003   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-11-29T05:57:58,006   creating build/lib/deepspeed/ops/transformer
2024-11-29T05:57:58,007   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-11-29T05:57:58,010   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-11-29T05:57:58,012   creating build/lib/deepspeed/ops/random_ltd
2024-11-29T05:57:58,013   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-11-29T05:57:58,016   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-11-29T05:57:58,019   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:57:58,020   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:57:58,023   creating build/lib/deepspeed/ops/op_builder/mlu
2024-11-29T05:57:58,024   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-29T05:57:58,026   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-29T05:57:58,028   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-29T05:57:58,030   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-29T05:57:58,032   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-29T05:57:58,034   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2024-11-29T05:57:58,036   creating build/lib/deepspeed/ops/op_builder/hpu
2024-11-29T05:57:58,038   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-29T05:57:58,040   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-29T05:57:58,042   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-29T05:57:58,044   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-29T05:57:58,046   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-29T05:57:58,048   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-11-29T05:57:58,051   creating build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,052   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,054   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,056   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,058   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,061   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,063   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,064   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,066   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,069   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,071   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-11-29T05:57:58,074   creating build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,075   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,078   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,081   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,085   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,089   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,095   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,097   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,099   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,101   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-11-29T05:57:58,104   creating build/lib/deepspeed/ops/op_builder/cpu
2024-11-29T05:57:58,105   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-29T05:57:58,107   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-29T05:57:58,109   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-29T05:57:58,111   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-29T05:57:58,113   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-29T05:57:58,115   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-29T05:57:58,117   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-11-29T05:57:58,120   creating build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,121   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,123   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,125   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,128   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,130   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,133   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,136   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,138   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,140   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,143   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-11-29T05:57:58,146   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,147   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,149   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,151   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,152   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,154   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,156   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,158   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,160   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,162   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,164   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,167   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,169   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,171   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,174   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,176   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,178   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,180   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,182   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,184   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,187   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,189   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,191   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,193   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:57:58,196   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,198   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,201   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,203   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,205   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,207   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,210   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,212   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,214   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,217   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,219   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-11-29T05:57:58,223   creating build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,224   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,227   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,229   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,232   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,234   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,237   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,239   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,241   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,244   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,246   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,249   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,251   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,254   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,256   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,258   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,260   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,262   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,265   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,267   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-11-29T05:57:58,269   creating build/lib/deepspeed/module_inject/containers/features
2024-11-29T05:57:58,271   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-29T05:57:58,274   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-29T05:57:58,276   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-29T05:57:58,278   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-29T05:57:58,280   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-29T05:57:58,283   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-29T05:57:58,284   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-11-29T05:57:58,287   running egg_info
2024-11-29T05:57:58,317   writing deepspeed.egg-info/PKG-INFO
2024-11-29T05:57:58,349   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-11-29T05:57:58,351   writing entry points to deepspeed.egg-info/entry_points.txt
2024-11-29T05:57:58,369   writing requirements to deepspeed.egg-info/requires.txt
2024-11-29T05:57:58,370   writing top-level names to deepspeed.egg-info/top_level.txt
2024-11-29T05:57:58,508   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-11-29T05:57:58,580   reading manifest template 'MANIFEST.in'
2024-11-29T05:57:58,581   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-11-29T05:57:58,582   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-11-29T05:58:00,221   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-11-29T05:58:01,214   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-11-29T05:58:02,121   warning: no files found matching '*.tr' under directory 'csrc'
2024-11-29T05:58:02,280   warning: no files found matching '*.cc' under directory 'csrc'
2024-11-29T05:58:02,336   warning: no files found matching '*.py' under directory 'benchmarks'
2024-11-29T05:58:02,342   adding license file 'LICENSE'
2024-11-29T05:58:02,393   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-11-29T05:58:02,401   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-11-29T05:58:02,402   !!

2024-11-29T05:58:02,403           ********************************************************************************
2024-11-29T05:58:02,404           ############################
2024-11-29T05:58:02,405           # Package would be ignored #
2024-11-29T05:58:02,405           ############################
2024-11-29T05:58:02,406           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-11-29T05:58:02,406           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,408           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,408           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-11-29T05:58:02,409           to the `packages` configuration field.

2024-11-29T05:58:02,410           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,411           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,411           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,412           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,414           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,415           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-11-29T05:58:02,415           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-11-29T05:58:02,416           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,417           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,417           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,418           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,419           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,420           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,420                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,421                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,421                 directory, all directories are treated like packages.
2024-11-29T05:58:02,421           ********************************************************************************

2024-11-29T05:58:02,422   !!
2024-11-29T05:58:02,423     check.warn(importable)
2024-11-29T05:58:02,423   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-11-29T05:58:02,423   !!

2024-11-29T05:58:02,424           ********************************************************************************
2024-11-29T05:58:02,425           ############################
2024-11-29T05:58:02,426           # Package would be ignored #
2024-11-29T05:58:02,426           ############################
2024-11-29T05:58:02,427           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-11-29T05:58:02,427           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,428           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,428           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-11-29T05:58:02,429           to the `packages` configuration field.

2024-11-29T05:58:02,430           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,430           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,431           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,432           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,432           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,433           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-11-29T05:58:02,434           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-11-29T05:58:02,434           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,435           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,435           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,436           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,438           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,439           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,440                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,440                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,441                 directory, all directories are treated like packages.
2024-11-29T05:58:02,441           ********************************************************************************

2024-11-29T05:58:02,442   !!
2024-11-29T05:58:02,443     check.warn(importable)
2024-11-29T05:58:02,443   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-11-29T05:58:02,443   !!

2024-11-29T05:58:02,444           ********************************************************************************
2024-11-29T05:58:02,445           ############################
2024-11-29T05:58:02,445           # Package would be ignored #
2024-11-29T05:58:02,445           ############################
2024-11-29T05:58:02,446           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-11-29T05:58:02,446           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,447           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,447           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-11-29T05:58:02,447           to the `packages` configuration field.

2024-11-29T05:58:02,448           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,449           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,450           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,451           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,453           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,455           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-11-29T05:58:02,455           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-11-29T05:58:02,456           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,456           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,456           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,457           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,458           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,460           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,461                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,461                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,462                 directory, all directories are treated like packages.
2024-11-29T05:58:02,462           ********************************************************************************

2024-11-29T05:58:02,463   !!
2024-11-29T05:58:02,464     check.warn(importable)
2024-11-29T05:58:02,464   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-11-29T05:58:02,464   !!

2024-11-29T05:58:02,466           ********************************************************************************
2024-11-29T05:58:02,466           ############################
2024-11-29T05:58:02,466           # Package would be ignored #
2024-11-29T05:58:02,467           ############################
2024-11-29T05:58:02,467           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-11-29T05:58:02,468           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,469           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,470           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-11-29T05:58:02,470           to the `packages` configuration field.

2024-11-29T05:58:02,471           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,472           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,472           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,473           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,473           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,474           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-11-29T05:58:02,475           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-11-29T05:58:02,475           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,475           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,476           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,476           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,477           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,479           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,479                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,479                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,480                 directory, all directories are treated like packages.
2024-11-29T05:58:02,480           ********************************************************************************

2024-11-29T05:58:02,481   !!
2024-11-29T05:58:02,482     check.warn(importable)
2024-11-29T05:58:02,482   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-11-29T05:58:02,483   !!

2024-11-29T05:58:02,484           ********************************************************************************
2024-11-29T05:58:02,484           ############################
2024-11-29T05:58:02,485           # Package would be ignored #
2024-11-29T05:58:02,485           ############################
2024-11-29T05:58:02,485           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-11-29T05:58:02,486           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,487           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,487           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-11-29T05:58:02,488           to the `packages` configuration field.

2024-11-29T05:58:02,489           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,489           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,490           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,491           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,492           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,493           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-11-29T05:58:02,493           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-11-29T05:58:02,494           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,494           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,495           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,497           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,497           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,498           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,499                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,499                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,500                 directory, all directories are treated like packages.
2024-11-29T05:58:02,500           ********************************************************************************

2024-11-29T05:58:02,501   !!
2024-11-29T05:58:02,501     check.warn(importable)
2024-11-29T05:58:02,501   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-11-29T05:58:02,502   !!

2024-11-29T05:58:02,503           ********************************************************************************
2024-11-29T05:58:02,503           ############################
2024-11-29T05:58:02,503           # Package would be ignored #
2024-11-29T05:58:02,504           ############################
2024-11-29T05:58:02,504           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-11-29T05:58:02,504           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,505           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,506           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-11-29T05:58:02,506           to the `packages` configuration field.

2024-11-29T05:58:02,507           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,507           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,508           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,508           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,509           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,510           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-11-29T05:58:02,511           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-11-29T05:58:02,511           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,512           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,512           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,513           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,514           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,515           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,516                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,516                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,517                 directory, all directories are treated like packages.
2024-11-29T05:58:02,517           ********************************************************************************

2024-11-29T05:58:02,518   !!
2024-11-29T05:58:02,519     check.warn(importable)
2024-11-29T05:58:02,519   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-11-29T05:58:02,520   !!

2024-11-29T05:58:02,522           ********************************************************************************
2024-11-29T05:58:02,522           ############################
2024-11-29T05:58:02,522           # Package would be ignored #
2024-11-29T05:58:02,523           ############################
2024-11-29T05:58:02,523           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-11-29T05:58:02,524           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,524           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,525           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-11-29T05:58:02,525           to the `packages` configuration field.

2024-11-29T05:58:02,526           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,526           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,526           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,527           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,528           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,529           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-11-29T05:58:02,529           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-11-29T05:58:02,530           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,530           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,531           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,531           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,532           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,534           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,534                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,535                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,535                 directory, all directories are treated like packages.
2024-11-29T05:58:02,536           ********************************************************************************

2024-11-29T05:58:02,537   !!
2024-11-29T05:58:02,538     check.warn(importable)
2024-11-29T05:58:02,538   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-11-29T05:58:02,539   !!

2024-11-29T05:58:02,540           ********************************************************************************
2024-11-29T05:58:02,540           ############################
2024-11-29T05:58:02,541           # Package would be ignored #
2024-11-29T05:58:02,541           ############################
2024-11-29T05:58:02,542           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-11-29T05:58:02,542           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,544           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,544           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-11-29T05:58:02,544           to the `packages` configuration field.

2024-11-29T05:58:02,546           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,546           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,547           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,548           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,549           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,550           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-11-29T05:58:02,551           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-11-29T05:58:02,551           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,551           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,552           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,552           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,553           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,554           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,555                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,555                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,555                 directory, all directories are treated like packages.
2024-11-29T05:58:02,556           ********************************************************************************

2024-11-29T05:58:02,556   !!
2024-11-29T05:58:02,557     check.warn(importable)
2024-11-29T05:58:02,557   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-11-29T05:58:02,558   !!

2024-11-29T05:58:02,558           ********************************************************************************
2024-11-29T05:58:02,559           ############################
2024-11-29T05:58:02,559           # Package would be ignored #
2024-11-29T05:58:02,560           ############################
2024-11-29T05:58:02,560           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-11-29T05:58:02,561           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,562           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,563           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-11-29T05:58:02,563           to the `packages` configuration field.

2024-11-29T05:58:02,564           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,565           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,566           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,571           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,572           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,573           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-11-29T05:58:02,573           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-11-29T05:58:02,574           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,574           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,574           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,575           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,576           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,578           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,579                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,579                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,580                 directory, all directories are treated like packages.
2024-11-29T05:58:02,580           ********************************************************************************

2024-11-29T05:58:02,582   !!
2024-11-29T05:58:02,582     check.warn(importable)
2024-11-29T05:58:02,582   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-11-29T05:58:02,583   !!

2024-11-29T05:58:02,583           ********************************************************************************
2024-11-29T05:58:02,584           ############################
2024-11-29T05:58:02,584           # Package would be ignored #
2024-11-29T05:58:02,584           ############################
2024-11-29T05:58:02,585           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-11-29T05:58:02,585           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,586           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,586           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-11-29T05:58:02,587           to the `packages` configuration field.

2024-11-29T05:58:02,588           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,588           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,588           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,589           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,590           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,591           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-11-29T05:58:02,591           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-11-29T05:58:02,592           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,592           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,593           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,594           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,595           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,596           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,597                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,597                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,598                 directory, all directories are treated like packages.
2024-11-29T05:58:02,598           ********************************************************************************

2024-11-29T05:58:02,599   !!
2024-11-29T05:58:02,600     check.warn(importable)
2024-11-29T05:58:02,600   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-11-29T05:58:02,601   !!

2024-11-29T05:58:02,602           ********************************************************************************
2024-11-29T05:58:02,602           ############################
2024-11-29T05:58:02,602           # Package would be ignored #
2024-11-29T05:58:02,603           ############################
2024-11-29T05:58:02,603           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-11-29T05:58:02,604           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,605           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,605           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-11-29T05:58:02,606           to the `packages` configuration field.

2024-11-29T05:58:02,607           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,607           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,608           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,608           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,609           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,610           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-11-29T05:58:02,610           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-11-29T05:58:02,610           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,611           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,611           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,612           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,613           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,614           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,615                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,615                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,616                 directory, all directories are treated like packages.
2024-11-29T05:58:02,616           ********************************************************************************

2024-11-29T05:58:02,617   !!
2024-11-29T05:58:02,617     check.warn(importable)
2024-11-29T05:58:02,618   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-11-29T05:58:02,618   !!

2024-11-29T05:58:02,619           ********************************************************************************
2024-11-29T05:58:02,620           ############################
2024-11-29T05:58:02,620           # Package would be ignored #
2024-11-29T05:58:02,621           ############################
2024-11-29T05:58:02,622           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-11-29T05:58:02,622           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,623           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,624           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-11-29T05:58:02,624           to the `packages` configuration field.

2024-11-29T05:58:02,626           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,626           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,626           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,627           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,628           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,629           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-11-29T05:58:02,630           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-11-29T05:58:02,630           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,631           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,631           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,632           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,634           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,635           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,635                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,636                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,636                 directory, all directories are treated like packages.
2024-11-29T05:58:02,637           ********************************************************************************

2024-11-29T05:58:02,637   !!
2024-11-29T05:58:02,638     check.warn(importable)
2024-11-29T05:58:02,638   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-11-29T05:58:02,638   !!

2024-11-29T05:58:02,639           ********************************************************************************
2024-11-29T05:58:02,640           ############################
2024-11-29T05:58:02,640           # Package would be ignored #
2024-11-29T05:58:02,640           ############################
2024-11-29T05:58:02,641           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-11-29T05:58:02,642           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,643           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,643           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-11-29T05:58:02,643           to the `packages` configuration field.

2024-11-29T05:58:02,644           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,645           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,645           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,647           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,648           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,649           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-11-29T05:58:02,649           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-11-29T05:58:02,650           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,650           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,651           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,652           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,653           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,654           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,655                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,655                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,656                 directory, all directories are treated like packages.
2024-11-29T05:58:02,656           ********************************************************************************

2024-11-29T05:58:02,657   !!
2024-11-29T05:58:02,658     check.warn(importable)
2024-11-29T05:58:02,658   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-11-29T05:58:02,659   !!

2024-11-29T05:58:02,660           ********************************************************************************
2024-11-29T05:58:02,661           ############################
2024-11-29T05:58:02,661           # Package would be ignored #
2024-11-29T05:58:02,662           ############################
2024-11-29T05:58:02,662           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-11-29T05:58:02,663           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,664           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,664           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-11-29T05:58:02,665           to the `packages` configuration field.

2024-11-29T05:58:02,665           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,666           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,666           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,667           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,668           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,668           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-11-29T05:58:02,669           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-11-29T05:58:02,669           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,669           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,670           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,670           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,671           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,672           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,673                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,674                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,674                 directory, all directories are treated like packages.
2024-11-29T05:58:02,675           ********************************************************************************

2024-11-29T05:58:02,676   !!
2024-11-29T05:58:02,676     check.warn(importable)
2024-11-29T05:58:02,677   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-11-29T05:58:02,678   !!

2024-11-29T05:58:02,679           ********************************************************************************
2024-11-29T05:58:02,679           ############################
2024-11-29T05:58:02,680           # Package would be ignored #
2024-11-29T05:58:02,681           ############################
2024-11-29T05:58:02,681           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-11-29T05:58:02,682           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,683           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,683           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-11-29T05:58:02,683           to the `packages` configuration field.

2024-11-29T05:58:02,684           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,685           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,685           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,687           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,688           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,689           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-11-29T05:58:02,690           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-11-29T05:58:02,690           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,691           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,692           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,692           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,693           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,694           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,695                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,695                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,696                 directory, all directories are treated like packages.
2024-11-29T05:58:02,696           ********************************************************************************

2024-11-29T05:58:02,697   !!
2024-11-29T05:58:02,697     check.warn(importable)
2024-11-29T05:58:02,697   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-11-29T05:58:02,698   !!

2024-11-29T05:58:02,699           ********************************************************************************
2024-11-29T05:58:02,699           ############################
2024-11-29T05:58:02,699           # Package would be ignored #
2024-11-29T05:58:02,700           ############################
2024-11-29T05:58:02,700           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-11-29T05:58:02,700           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,701           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,702           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-11-29T05:58:02,702           to the `packages` configuration field.

2024-11-29T05:58:02,703           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,704           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,705           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,705           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,707           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,708           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-11-29T05:58:02,708           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-11-29T05:58:02,709           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,709           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,710           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,711           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,712           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,713           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,714                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,714                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,714                 directory, all directories are treated like packages.
2024-11-29T05:58:02,715           ********************************************************************************

2024-11-29T05:58:02,716   !!
2024-11-29T05:58:02,716     check.warn(importable)
2024-11-29T05:58:02,717   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-11-29T05:58:02,718   !!

2024-11-29T05:58:02,719           ********************************************************************************
2024-11-29T05:58:02,719           ############################
2024-11-29T05:58:02,719           # Package would be ignored #
2024-11-29T05:58:02,720           ############################
2024-11-29T05:58:02,720           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-11-29T05:58:02,720           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,721           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,722           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-11-29T05:58:02,722           to the `packages` configuration field.

2024-11-29T05:58:02,723           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,724           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,724           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,725           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,726           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,727           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-11-29T05:58:02,727           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-11-29T05:58:02,727           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,728           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,728           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,729           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,731           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,732           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,733                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,734                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,734                 directory, all directories are treated like packages.
2024-11-29T05:58:02,735           ********************************************************************************

2024-11-29T05:58:02,736   !!
2024-11-29T05:58:02,736     check.warn(importable)
2024-11-29T05:58:02,737   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-11-29T05:58:02,738   !!

2024-11-29T05:58:02,739           ********************************************************************************
2024-11-29T05:58:02,740           ############################
2024-11-29T05:58:02,741           # Package would be ignored #
2024-11-29T05:58:02,773           ############################
2024-11-29T05:58:02,774           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-11-29T05:58:02,774           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,775           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,776           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-11-29T05:58:02,776           to the `packages` configuration field.

2024-11-29T05:58:02,778           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,778           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,779           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,780           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,780           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,787           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-11-29T05:58:02,787           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-11-29T05:58:02,787           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,788           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,788           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,789           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,790           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,791           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,791                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,792                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,792                 directory, all directories are treated like packages.
2024-11-29T05:58:02,793           ********************************************************************************

2024-11-29T05:58:02,793   !!
2024-11-29T05:58:02,794     check.warn(importable)
2024-11-29T05:58:02,794   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-11-29T05:58:02,795   !!

2024-11-29T05:58:02,796           ********************************************************************************
2024-11-29T05:58:02,796           ############################
2024-11-29T05:58:02,797           # Package would be ignored #
2024-11-29T05:58:02,798           ############################
2024-11-29T05:58:02,798           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-11-29T05:58:02,799           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,800           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,800           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-11-29T05:58:02,801           to the `packages` configuration field.

2024-11-29T05:58:02,802           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,803           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,803           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,804           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,805           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,806           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-11-29T05:58:02,807           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-11-29T05:58:02,807           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,808           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,808           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,809           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,810           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,811           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,812                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,812                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,812                 directory, all directories are treated like packages.
2024-11-29T05:58:02,813           ********************************************************************************

2024-11-29T05:58:02,814   !!
2024-11-29T05:58:02,814     check.warn(importable)
2024-11-29T05:58:02,815   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-11-29T05:58:02,815   !!

2024-11-29T05:58:02,816           ********************************************************************************
2024-11-29T05:58:02,816           ############################
2024-11-29T05:58:02,816           # Package would be ignored #
2024-11-29T05:58:02,817           ############################
2024-11-29T05:58:02,818           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-11-29T05:58:02,818           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,819           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,819           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-11-29T05:58:02,820           to the `packages` configuration field.

2024-11-29T05:58:02,821           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,821           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,822           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,823           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,824           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,826           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-11-29T05:58:02,826           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-11-29T05:58:02,827           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,828           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,828           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,829           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,830           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,832           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,832                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,833                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,833                 directory, all directories are treated like packages.
2024-11-29T05:58:02,834           ********************************************************************************

2024-11-29T05:58:02,835   !!
2024-11-29T05:58:02,836     check.warn(importable)
2024-11-29T05:58:02,836   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-11-29T05:58:02,837   !!

2024-11-29T05:58:02,838           ********************************************************************************
2024-11-29T05:58:02,839           ############################
2024-11-29T05:58:02,840           # Package would be ignored #
2024-11-29T05:58:02,840           ############################
2024-11-29T05:58:02,840           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-11-29T05:58:02,841           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,842           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,842           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-11-29T05:58:02,842           to the `packages` configuration field.

2024-11-29T05:58:02,843           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,843           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,844           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,844           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,846           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,846           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-11-29T05:58:02,847           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-11-29T05:58:02,847           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,847           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,848           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,849           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,850           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,851           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,852                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,853                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,853                 directory, all directories are treated like packages.
2024-11-29T05:58:02,854           ********************************************************************************

2024-11-29T05:58:02,855   !!
2024-11-29T05:58:02,855     check.warn(importable)
2024-11-29T05:58:02,856   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-11-29T05:58:02,856   !!

2024-11-29T05:58:02,857           ********************************************************************************
2024-11-29T05:58:02,858           ############################
2024-11-29T05:58:02,858           # Package would be ignored #
2024-11-29T05:58:02,858           ############################
2024-11-29T05:58:02,859           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-11-29T05:58:02,859           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,860           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,861           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-11-29T05:58:02,862           to the `packages` configuration field.

2024-11-29T05:58:02,863           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,863           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,864           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,865           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,866           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,867           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-11-29T05:58:02,867           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-11-29T05:58:02,868           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,868           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,868           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,869           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,870           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,871           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,871                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,871                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,872                 directory, all directories are treated like packages.
2024-11-29T05:58:02,872           ********************************************************************************

2024-11-29T05:58:02,873   !!
2024-11-29T05:58:02,874     check.warn(importable)
2024-11-29T05:58:02,874   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-11-29T05:58:02,874   !!

2024-11-29T05:58:02,875           ********************************************************************************
2024-11-29T05:58:02,876           ############################
2024-11-29T05:58:02,876           # Package would be ignored #
2024-11-29T05:58:02,877           ############################
2024-11-29T05:58:02,877           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-11-29T05:58:02,878           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,879           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,879           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-11-29T05:58:02,880           to the `packages` configuration field.

2024-11-29T05:58:02,881           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,881           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,882           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,883           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,884           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,885           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-11-29T05:58:02,886           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-11-29T05:58:02,886           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,887           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,887           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,888           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,890           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,891           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,892                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,892                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,893                 directory, all directories are treated like packages.
2024-11-29T05:58:02,894           ********************************************************************************

2024-11-29T05:58:02,895   !!
2024-11-29T05:58:02,895     check.warn(importable)
2024-11-29T05:58:02,895   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2024-11-29T05:58:02,896   !!

2024-11-29T05:58:02,897           ********************************************************************************
2024-11-29T05:58:02,897           ############################
2024-11-29T05:58:02,897           # Package would be ignored #
2024-11-29T05:58:02,898           ############################
2024-11-29T05:58:02,898           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2024-11-29T05:58:02,898           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,899           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,899           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2024-11-29T05:58:02,900           to the `packages` configuration field.

2024-11-29T05:58:02,901           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,901           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,901           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,902           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,903           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,904           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2024-11-29T05:58:02,905           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2024-11-29T05:58:02,906           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,906           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,907           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,908           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,909           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,911           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,912                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,912                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,913                 directory, all directories are treated like packages.
2024-11-29T05:58:02,913           ********************************************************************************

2024-11-29T05:58:02,914   !!
2024-11-29T05:58:02,915     check.warn(importable)
2024-11-29T05:58:02,915   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-11-29T05:58:02,916   !!

2024-11-29T05:58:02,917           ********************************************************************************
2024-11-29T05:58:02,918           ############################
2024-11-29T05:58:02,918           # Package would be ignored #
2024-11-29T05:58:02,919           ############################
2024-11-29T05:58:02,919           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-11-29T05:58:02,920           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,921           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,922           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-11-29T05:58:02,923           to the `packages` configuration field.

2024-11-29T05:58:02,924           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,924           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,924           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,925           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,926           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,927           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-11-29T05:58:02,927           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-11-29T05:58:02,928           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,928           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,928           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,929           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,930           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,931           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,932                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,932                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,933                 directory, all directories are treated like packages.
2024-11-29T05:58:02,933           ********************************************************************************

2024-11-29T05:58:02,934   !!
2024-11-29T05:58:02,935     check.warn(importable)
2024-11-29T05:58:02,935   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-11-29T05:58:02,936   !!

2024-11-29T05:58:02,937           ********************************************************************************
2024-11-29T05:58:02,937           ############################
2024-11-29T05:58:02,938           # Package would be ignored #
2024-11-29T05:58:02,938           ############################
2024-11-29T05:58:02,939           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-11-29T05:58:02,939           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,941           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,941           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-11-29T05:58:02,942           to the `packages` configuration field.

2024-11-29T05:58:02,943           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,944           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,944           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,945           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,946           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,947           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-11-29T05:58:02,948           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-11-29T05:58:02,948           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,949           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,950           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,951           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,952           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,953           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,953                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,954                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,954                 directory, all directories are treated like packages.
2024-11-29T05:58:02,955           ********************************************************************************

2024-11-29T05:58:02,956   !!
2024-11-29T05:58:02,956     check.warn(importable)
2024-11-29T05:58:02,957   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-11-29T05:58:02,957   !!

2024-11-29T05:58:02,958           ********************************************************************************
2024-11-29T05:58:02,958           ############################
2024-11-29T05:58:02,959           # Package would be ignored #
2024-11-29T05:58:02,959           ############################
2024-11-29T05:58:02,960           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-11-29T05:58:02,960           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,961           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,962           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-11-29T05:58:02,962           to the `packages` configuration field.

2024-11-29T05:58:02,964           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,964           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,965           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,966           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,967           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,968           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-11-29T05:58:02,968           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-11-29T05:58:02,969           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,969           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,970           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,970           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,971           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,973           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,974                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,974                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,975                 directory, all directories are treated like packages.
2024-11-29T05:58:02,975           ********************************************************************************

2024-11-29T05:58:02,976   !!
2024-11-29T05:58:02,977     check.warn(importable)
2024-11-29T05:58:02,977   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-11-29T05:58:02,978   !!

2024-11-29T05:58:02,979           ********************************************************************************
2024-11-29T05:58:02,979           ############################
2024-11-29T05:58:02,980           # Package would be ignored #
2024-11-29T05:58:02,980           ############################
2024-11-29T05:58:02,981           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-11-29T05:58:02,982           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:02,982           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:02,983           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-11-29T05:58:02,983           to the `packages` configuration field.

2024-11-29T05:58:02,984           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:02,985           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:02,985           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:02,986           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:02,987           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:02,988           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-11-29T05:58:02,988           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-11-29T05:58:02,989           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:02,990           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:02,990           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:02,991           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:02,992           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:02,994           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:02,994                 even if it does not contain any `.py` files.
2024-11-29T05:58:02,995                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:02,995                 directory, all directories are treated like packages.
2024-11-29T05:58:02,995           ********************************************************************************

2024-11-29T05:58:02,996   !!
2024-11-29T05:58:02,997     check.warn(importable)
2024-11-29T05:58:02,997   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-11-29T05:58:02,998   !!

2024-11-29T05:58:02,999           ********************************************************************************
2024-11-29T05:58:02,999           ############################
2024-11-29T05:58:03,000           # Package would be ignored #
2024-11-29T05:58:03,000           ############################
2024-11-29T05:58:03,001           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-11-29T05:58:03,002           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,003           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,003           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-11-29T05:58:03,004           to the `packages` configuration field.

2024-11-29T05:58:03,005           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,006           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,006           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,007           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,008           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,009           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-11-29T05:58:03,010           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-11-29T05:58:03,011           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,011           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,011           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,012           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,014           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,016           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,017                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,017                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,018                 directory, all directories are treated like packages.
2024-11-29T05:58:03,019           ********************************************************************************

2024-11-29T05:58:03,021   !!
2024-11-29T05:58:03,021     check.warn(importable)
2024-11-29T05:58:03,022   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-11-29T05:58:03,023   !!

2024-11-29T05:58:03,025           ********************************************************************************
2024-11-29T05:58:03,026           ############################
2024-11-29T05:58:03,027           # Package would be ignored #
2024-11-29T05:58:03,028           ############################
2024-11-29T05:58:03,028           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-11-29T05:58:03,029           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,031           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,032           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-11-29T05:58:03,033           to the `packages` configuration field.

2024-11-29T05:58:03,035           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,036           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,036           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,038           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,040           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,041           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-11-29T05:58:03,042           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-11-29T05:58:03,043           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,044           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,045           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,047           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,048           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,051           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,052                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,052                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,053                 directory, all directories are treated like packages.
2024-11-29T05:58:03,054           ********************************************************************************

2024-11-29T05:58:03,056   !!
2024-11-29T05:58:03,056     check.warn(importable)
2024-11-29T05:58:03,057   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-11-29T05:58:03,058   !!

2024-11-29T05:58:03,060           ********************************************************************************
2024-11-29T05:58:03,061           ############################
2024-11-29T05:58:03,061           # Package would be ignored #
2024-11-29T05:58:03,062           ############################
2024-11-29T05:58:03,063           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-11-29T05:58:03,064           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,065           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,066           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-11-29T05:58:03,067           to the `packages` configuration field.

2024-11-29T05:58:03,069           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,069           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,070           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,072           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,074           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,076           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-11-29T05:58:03,076           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-11-29T05:58:03,077           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,078           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,079           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,080           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,082           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,085           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,086                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,087                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,088                 directory, all directories are treated like packages.
2024-11-29T05:58:03,088           ********************************************************************************

2024-11-29T05:58:03,090   !!
2024-11-29T05:58:03,091     check.warn(importable)
2024-11-29T05:58:03,092   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-11-29T05:58:03,093   !!

2024-11-29T05:58:03,094           ********************************************************************************
2024-11-29T05:58:03,095           ############################
2024-11-29T05:58:03,096           # Package would be ignored #
2024-11-29T05:58:03,097           ############################
2024-11-29T05:58:03,097           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-11-29T05:58:03,098           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,100           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,101           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-11-29T05:58:03,101           to the `packages` configuration field.

2024-11-29T05:58:03,103           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,104           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,105           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,106           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,108           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,109           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-11-29T05:58:03,111           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-11-29T05:58:03,111           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,113           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,113           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,115           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,116           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,118           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,118                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,119                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,119                 directory, all directories are treated like packages.
2024-11-29T05:58:03,120           ********************************************************************************

2024-11-29T05:58:03,121   !!
2024-11-29T05:58:03,122     check.warn(importable)
2024-11-29T05:58:03,122   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-11-29T05:58:03,123   !!

2024-11-29T05:58:03,124           ********************************************************************************
2024-11-29T05:58:03,124           ############################
2024-11-29T05:58:03,125           # Package would be ignored #
2024-11-29T05:58:03,125           ############################
2024-11-29T05:58:03,126           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-11-29T05:58:03,126           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,127           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,128           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-11-29T05:58:03,128           to the `packages` configuration field.

2024-11-29T05:58:03,130           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,130           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,131           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,132           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,133           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,134           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-11-29T05:58:03,135           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-11-29T05:58:03,135           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,136           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,136           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,138           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,139           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,141           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,142                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,143                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,144                 directory, all directories are treated like packages.
2024-11-29T05:58:03,144           ********************************************************************************

2024-11-29T05:58:03,146   !!
2024-11-29T05:58:03,147     check.warn(importable)
2024-11-29T05:58:03,148   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-11-29T05:58:03,149   !!

2024-11-29T05:58:03,150           ********************************************************************************
2024-11-29T05:58:03,151           ############################
2024-11-29T05:58:03,152           # Package would be ignored #
2024-11-29T05:58:03,153           ############################
2024-11-29T05:58:03,154           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-11-29T05:58:03,154           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,155           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,156           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-11-29T05:58:03,156           to the `packages` configuration field.

2024-11-29T05:58:03,158           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,158           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,159           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,160           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,161           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,162           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-11-29T05:58:03,163           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-11-29T05:58:03,163           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,164           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,164           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,166           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,167           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,168           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,169                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,170                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,171                 directory, all directories are treated like packages.
2024-11-29T05:58:03,171           ********************************************************************************

2024-11-29T05:58:03,173   !!
2024-11-29T05:58:03,173     check.warn(importable)
2024-11-29T05:58:03,174   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-11-29T05:58:03,175   !!

2024-11-29T05:58:03,176           ********************************************************************************
2024-11-29T05:58:03,176           ############################
2024-11-29T05:58:03,177           # Package would be ignored #
2024-11-29T05:58:03,178           ############################
2024-11-29T05:58:03,181           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-11-29T05:58:03,183           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,185           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,186           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-11-29T05:58:03,187           to the `packages` configuration field.

2024-11-29T05:58:03,188           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,188           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,189           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,190           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,191           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,192           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-11-29T05:58:03,193           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-11-29T05:58:03,194           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,194           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,194           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,195           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,196           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,198           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,199                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,199                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,200                 directory, all directories are treated like packages.
2024-11-29T05:58:03,201           ********************************************************************************

2024-11-29T05:58:03,202   !!
2024-11-29T05:58:03,202     check.warn(importable)
2024-11-29T05:58:03,203   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-11-29T05:58:03,204   !!

2024-11-29T05:58:03,205           ********************************************************************************
2024-11-29T05:58:03,205           ############################
2024-11-29T05:58:03,206           # Package would be ignored #
2024-11-29T05:58:03,207           ############################
2024-11-29T05:58:03,207           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-11-29T05:58:03,208           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,210           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,210           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-11-29T05:58:03,211           to the `packages` configuration field.

2024-11-29T05:58:03,212           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,213           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,214           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,215           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,217           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,218           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-11-29T05:58:03,219           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-11-29T05:58:03,219           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,220           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,221           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,222           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,224           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,226           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,227                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,228                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,229                 directory, all directories are treated like packages.
2024-11-29T05:58:03,229           ********************************************************************************

2024-11-29T05:58:03,230   !!
2024-11-29T05:58:03,231     check.warn(importable)
2024-11-29T05:58:03,232   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-11-29T05:58:03,233   !!

2024-11-29T05:58:03,234           ********************************************************************************
2024-11-29T05:58:03,235           ############################
2024-11-29T05:58:03,236           # Package would be ignored #
2024-11-29T05:58:03,236           ############################
2024-11-29T05:58:03,237           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-11-29T05:58:03,238           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,239           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,239           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-11-29T05:58:03,240           to the `packages` configuration field.

2024-11-29T05:58:03,241           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,241           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,242           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,243           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,245           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,247           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-11-29T05:58:03,248           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-11-29T05:58:03,249           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,250           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,251           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,252           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,253           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,256           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,257                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,258                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,259                 directory, all directories are treated like packages.
2024-11-29T05:58:03,260           ********************************************************************************

2024-11-29T05:58:03,262   !!
2024-11-29T05:58:03,263     check.warn(importable)
2024-11-29T05:58:03,264   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-11-29T05:58:03,265   !!

2024-11-29T05:58:03,268           ********************************************************************************
2024-11-29T05:58:03,268           ############################
2024-11-29T05:58:03,269           # Package would be ignored #
2024-11-29T05:58:03,269           ############################
2024-11-29T05:58:03,270           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-11-29T05:58:03,271           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,272           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,272           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-11-29T05:58:03,273           to the `packages` configuration field.

2024-11-29T05:58:03,274           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,274           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,275           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,276           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,277           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,278           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-11-29T05:58:03,279           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-11-29T05:58:03,279           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,280           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,280           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,281           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,282           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,284           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,284                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,285                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,285                 directory, all directories are treated like packages.
2024-11-29T05:58:03,286           ********************************************************************************

2024-11-29T05:58:03,287   !!
2024-11-29T05:58:03,287     check.warn(importable)
2024-11-29T05:58:03,288   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-11-29T05:58:03,288   !!

2024-11-29T05:58:03,290           ********************************************************************************
2024-11-29T05:58:03,290           ############################
2024-11-29T05:58:03,291           # Package would be ignored #
2024-11-29T05:58:03,291           ############################
2024-11-29T05:58:03,292           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-11-29T05:58:03,292           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,294           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,294           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-11-29T05:58:03,295           to the `packages` configuration field.

2024-11-29T05:58:03,296           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,296           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,297           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,298           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,299           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,300           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-11-29T05:58:03,300           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-11-29T05:58:03,301           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,301           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,302           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,303           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,303           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,305           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,306                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,306                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,306                 directory, all directories are treated like packages.
2024-11-29T05:58:03,307           ********************************************************************************

2024-11-29T05:58:03,308   !!
2024-11-29T05:58:03,309     check.warn(importable)
2024-11-29T05:58:03,309   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-11-29T05:58:03,309   !!

2024-11-29T05:58:03,310           ********************************************************************************
2024-11-29T05:58:03,311           ############################
2024-11-29T05:58:03,311           # Package would be ignored #
2024-11-29T05:58:03,312           ############################
2024-11-29T05:58:03,312           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-11-29T05:58:03,313           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,314           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,315           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-11-29T05:58:03,316           to the `packages` configuration field.

2024-11-29T05:58:03,317           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,317           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,318           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,319           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,320           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,322           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-11-29T05:58:03,322           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-11-29T05:58:03,323           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,323           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,324           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,326           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,327           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,330           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,330                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,332                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,332                 directory, all directories are treated like packages.
2024-11-29T05:58:03,334           ********************************************************************************

2024-11-29T05:58:03,335   !!
2024-11-29T05:58:03,336     check.warn(importable)
2024-11-29T05:58:03,337   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-11-29T05:58:03,337   !!

2024-11-29T05:58:03,339           ********************************************************************************
2024-11-29T05:58:03,340           ############################
2024-11-29T05:58:03,340           # Package would be ignored #
2024-11-29T05:58:03,341           ############################
2024-11-29T05:58:03,342           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-11-29T05:58:03,342           but it is absent from setuptools' `packages` configuration.

2024-11-29T05:58:03,344           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T05:58:03,344           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-11-29T05:58:03,345           to the `packages` configuration field.

2024-11-29T05:58:03,346           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T05:58:03,347           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T05:58:03,347           instead of `find_packages(...)`/`find:`).

2024-11-29T05:58:03,348           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T05:58:03,350           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T05:58:03,351           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-11-29T05:58:03,352           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-11-29T05:58:03,352           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T05:58:03,352           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T05:58:03,353           combination with a more fine grained `package-data` configuration.

2024-11-29T05:58:03,354           You can read more about "package data files" on setuptools documentation page:

2024-11-29T05:58:03,355           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T05:58:03,356           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T05:58:03,357                 even if it does not contain any `.py` files.
2024-11-29T05:58:03,358                 On the other hand, currently there is no concept of package data
2024-11-29T05:58:03,358                 directory, all directories are treated like packages.
2024-11-29T05:58:03,359           ********************************************************************************

2024-11-29T05:58:03,360   !!
2024-11-29T05:58:03,360     check.warn(importable)
2024-11-29T05:58:03,361   creating build/lib/deepspeed/autotuning/config_templates
2024-11-29T05:58:03,361   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-11-29T05:58:03,362   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-11-29T05:58:03,362   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-11-29T05:58:03,363   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-11-29T05:58:03,363   creating build/lib/deepspeed/ops/csrc/adagrad
2024-11-29T05:58:03,364   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-11-29T05:58:03,364   creating build/lib/deepspeed/ops/csrc/adam
2024-11-29T05:58:03,365   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-11-29T05:58:03,366   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-11-29T05:58:03,366   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-11-29T05:58:03,367   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-11-29T05:58:03,367   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-11-29T05:58:03,367   creating build/lib/deepspeed/ops/csrc/aio/common
2024-11-29T05:58:03,368   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-29T05:58:03,368   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-29T05:58:03,369   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-29T05:58:03,369   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-29T05:58:03,369   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-29T05:58:03,370   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-11-29T05:58:03,370   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,371   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,371   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,372   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,372   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,373   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,373   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,374   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,374   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,375   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,375   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,376   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,376   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,377   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,377   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,378   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,378   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,379   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:03,379   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-11-29T05:58:03,380   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-11-29T05:58:03,380   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-11-29T05:58:03,381   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-11-29T05:58:03,382   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:03,382   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:03,383   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:03,383   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:03,383   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:03,384   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-11-29T05:58:03,384   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-11-29T05:58:03,385   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:03,385   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:03,386   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:03,386   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:03,386   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:03,387   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:03,387   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:03,388   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:03,388   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:03,389   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:03,389   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:03,389   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:03,390   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:03,391   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:03,391   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:03,392   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:03,392   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:03,393   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:03,393   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:03,394   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:03,394   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:03,395   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:03,395   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:03,396   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:03,396   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:03,397   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:03,397   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:03,398   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:03,399   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-29T05:58:03,399   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-29T05:58:03,400   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-29T05:58:03,401   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-11-29T05:58:03,401   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-11-29T05:58:03,402   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-11-29T05:58:03,402   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-11-29T05:58:03,403   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-11-29T05:58:03,403   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-11-29T05:58:03,404   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:03,405   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:03,405   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:03,406   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:03,407   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:03,407   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:03,408   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:03,408   creating build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,409   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,409   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,410   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,410   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,411   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,412   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,413   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,413   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,414   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,414   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,415   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,416   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,416   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,418   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,419   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,419   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,420   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,421   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,422   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,423   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,423   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,424   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,425   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,426   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,427   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,428   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,429   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,429   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,430   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-11-29T05:58:03,430   creating build/lib/deepspeed/ops/csrc/lamb
2024-11-29T05:58:03,431   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-11-29T05:58:03,433   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-11-29T05:58:03,436   creating build/lib/deepspeed/ops/csrc/lion
2024-11-29T05:58:03,438   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-11-29T05:58:03,440   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-11-29T05:58:03,443   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-11-29T05:58:03,446   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-11-29T05:58:03,449   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-11-29T05:58:03,451   creating build/lib/deepspeed/ops/csrc/quantization
2024-11-29T05:58:03,453   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-29T05:58:03,456   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-29T05:58:03,461   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-11-29T05:58:03,464   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-29T05:58:03,467   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-29T05:58:03,470   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-29T05:58:03,473   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-11-29T05:58:03,476   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:03,477   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:03,480   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:03,483   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:03,486   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:03,489   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-11-29T05:58:03,491   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-11-29T05:58:03,494   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-11-29T05:58:03,497   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-11-29T05:58:03,500   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-11-29T05:58:03,503   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-11-29T05:58:03,504   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-11-29T05:58:03,507   creating build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,509   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,512   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,516   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,519   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,522   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,526   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,531   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,534   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-11-29T05:58:03,538   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,540   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,543   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,546   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,550   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,554   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,557   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,562   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,564   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,568   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,571   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:03,575   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-11-29T05:58:03,576   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-11-29T05:58:03,579   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-11-29T05:58:03,583   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-11-29T05:58:03,586   creating build/lib/deepspeed/ops/csrc/utils
2024-11-29T05:58:03,587   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-11-29T05:58:03,590   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-11-29T05:58:03,592   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-11-29T05:58:03,595   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-11-29T05:58:03,597   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-11-29T05:58:03,600   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-11-29T05:58:03,603   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-11-29T05:58:03,607   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-11-29T05:58:03,608   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-11-29T05:58:03,611   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:03,612   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:03,615   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:03,618   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:03,621   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:03,624   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:03,627   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-11-29T05:58:03,628   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-11-29T05:58:03,631   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-11-29T05:58:03,633   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-11-29T05:58:03,636   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-11-29T05:58:03,638   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-11-29T05:58:03,640   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-11-29T05:58:03,643   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:03,644   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:03,647   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:03,650   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:03,653   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:03,656   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:03,659   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-11-29T05:58:03,662   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-11-29T05:58:03,664   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-11-29T05:58:03,667   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-11-29T05:58:03,669   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-11-29T05:58:03,671   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-11-29T05:58:03,673   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-11-29T05:58:03,676   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-29T05:58:03,677   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-29T05:58:03,680   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-29T05:58:03,682   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-29T05:58:03,685   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:03,688   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:03,690   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:03,693   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:03,696   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:03,698   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:03,701   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:03,704   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:03,707   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:03,710   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:03,713   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,715   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,718   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,721   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,724   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,726   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,729   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,732   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,735   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,738   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:03,741   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:03,744   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:03,746   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:03,750   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:03,752   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:03,755   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:03,758   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:03,761   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:03,763   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:03,767   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:03,769   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:03,772   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:03,775   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:58:03,778   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:58:03,782   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:03,785   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:03,788   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:03,790   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:03,793   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:03,796   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:03,799   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:03,801   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:03,804   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:58:03,813   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:58:03,815   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:03,818   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:03,821   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:03,824   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:03,827   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:03,830   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:03,833   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:03,836   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:03,840   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:03,843   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:03,845   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:03,848   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:03,851   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:03,854   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:03,857   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:03,859   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:03,862   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:03,865   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:03,867   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:03,870   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:03,873   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:58:03,876   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:58:03,879   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:58:03,935   running build_scripts
2024-11-29T05:58:03,936   creating build/scripts-3.11
2024-11-29T05:58:03,938   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-11-29T05:58:03,940   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-11-29T05:58:03,942   copying and adjusting bin/ds -> build/scripts-3.11
2024-11-29T05:58:03,944   copying bin/ds_ssh -> build/scripts-3.11
2024-11-29T05:58:03,946   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-11-29T05:58:03,948   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-11-29T05:58:03,950   copying and adjusting bin/dsr -> build/scripts-3.11
2024-11-29T05:58:03,952   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-11-29T05:58:03,954   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2024-11-29T05:58:03,956   copying and adjusting bin/ds_io -> build/scripts-3.11
2024-11-29T05:58:03,957   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-11-29T05:58:03,958   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-11-29T05:58:03,959   changing mode of build/scripts-3.11/ds from 644 to 755
2024-11-29T05:58:03,959   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-11-29T05:58:03,960   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-11-29T05:58:03,961   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-11-29T05:58:03,962   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-11-29T05:58:03,963   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2024-11-29T05:58:03,963   changing mode of build/scripts-3.11/ds_io from 644 to 755
2024-11-29T05:58:03,992   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-11-29T05:58:03,992   !!

2024-11-29T05:58:03,994           ********************************************************************************
2024-11-29T05:58:03,994           Please avoid running ``setup.py`` directly.
2024-11-29T05:58:03,995           Instead, use pypa/build, pypa/installer or other
2024-11-29T05:58:03,995           standards-based tools.

2024-11-29T05:58:03,996           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-11-29T05:58:03,997           ********************************************************************************

2024-11-29T05:58:03,998   !!
2024-11-29T05:58:03,999     self.initialize_options()
2024-11-29T05:58:04,026   installing to build/bdist.linux-armv7l/wheel
2024-11-29T05:58:04,026   running install
2024-11-29T05:58:04,051   running install_lib
2024-11-29T05:58:04,080   creating build/bdist.linux-armv7l/wheel
2024-11-29T05:58:04,083   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-11-29T05:58:04,085   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-11-29T05:58:04,087   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-29T05:58:04,090   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-29T05:58:04,093   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-29T05:58:04,096   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-29T05:58:04,099   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-29T05:58:04,101   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-11-29T05:58:04,104   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-11-29T05:58:04,106   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-11-29T05:58:04,108   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-11-29T05:58:04,110   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-11-29T05:58:04,113   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-11-29T05:58:04,114   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-11-29T05:58:04,117   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-11-29T05:58:04,120   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-11-29T05:58:04,122   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-11-29T05:58:04,125   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-11-29T05:58:04,127   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,129   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,131   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,133   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,135   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,138   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,140   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,143   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,145   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,148   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-11-29T05:58:04,150   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-11-29T05:58:04,152   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-29T05:58:04,155   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-29T05:58:04,157   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-29T05:58:04,159   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-29T05:58:04,162   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-29T05:58:04,164   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-11-29T05:58:04,167   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-11-29T05:58:04,168   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-11-29T05:58:04,171   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-11-29T05:58:04,172   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-29T05:58:04,175   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-29T05:58:04,177   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-29T05:58:04,179   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-29T05:58:04,181   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-11-29T05:58:04,183   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-11-29T05:58:04,186   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-11-29T05:58:04,188   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-11-29T05:58:04,191   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:58:04,192   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:58:04,195   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:58:04,197   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:58:04,199   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-11-29T05:58:04,201   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:58:04,202   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:58:04,204   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:58:04,207   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:58:04,209   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-11-29T05:58:04,212   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:58:04,213   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:58:04,215   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:58:04,217   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:58:04,218   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-11-29T05:58:04,221   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:58:04,222   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:58:04,224   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:58:04,227   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:58:04,229   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-11-29T05:58:04,231   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-29T05:58:04,235   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,236   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,239   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,241   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,243   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,246   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,248   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,250   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,252   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,254   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-11-29T05:58:04,256   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-29T05:58:04,259   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-29T05:58:04,261   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-29T05:58:04,264   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:58:04,265   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:58:04,268   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:58:04,270   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:58:04,273   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-11-29T05:58:04,275   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:58:04,277   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:58:04,279   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:58:04,282   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:58:04,284   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-11-29T05:58:04,287   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:58:04,288   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:58:04,291   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:58:04,294   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:58:04,296   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-11-29T05:58:04,299   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:58:04,301   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:58:04,303   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:58:04,306   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:58:04,308   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-11-29T05:58:04,311   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,313   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,315   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,318   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,320   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,323   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,325   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,327   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,329   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,331   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-11-29T05:58:04,334   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-29T05:58:04,337   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-29T05:58:04,339   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:58:04,341   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:58:04,344   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:58:04,346   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:58:04,348   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-11-29T05:58:04,352   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:58:04,353   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:58:04,355   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:58:04,357   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:58:04,359   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-11-29T05:58:04,362   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-11-29T05:58:04,364   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,366   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,368   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-11-29T05:58:04,369   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-11-29T05:58:04,372   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-11-29T05:58:04,373   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-11-29T05:58:04,375   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-11-29T05:58:04,377   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,379   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,381   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,384   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,386   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,388   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,391   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-11-29T05:58:04,392   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-29T05:58:04,394   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-29T05:58:04,397   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-29T05:58:04,400   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-11-29T05:58:04,401   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-11-29T05:58:04,404   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-11-29T05:58:04,405   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-11-29T05:58:04,407   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-11-29T05:58:04,410   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-29T05:58:04,412   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-29T05:58:04,414   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-29T05:58:04,416   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-11-29T05:58:04,419   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-11-29T05:58:04,421   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:04,422   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:04,426   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:04,428   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:04,431   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:04,433   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-11-29T05:58:04,436   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-11-29T05:58:04,437   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-11-29T05:58:04,440   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:04,441   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:04,444   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:04,446   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:04,448   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:04,450   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:04,452   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-11-29T05:58:04,455   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-11-29T05:58:04,456   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-11-29T05:58:04,459   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:04,461   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:04,463   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:04,465   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:04,467   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:04,470   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-11-29T05:58:04,472   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-11-29T05:58:04,475   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-11-29T05:58:04,476   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:04,478   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:04,480   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:04,483   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:04,485   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:04,488   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,489   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,492   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,494   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,496   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,498   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,500   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,503   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,505   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,508   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-11-29T05:58:04,510   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:04,512   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-11-29T05:58:04,515   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:04,516   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:04,519   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:04,521   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:04,523   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:04,526   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:04,528   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:04,530   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-11-29T05:58:04,534   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:04,535   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:04,538   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:04,540   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:04,543   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:04,545   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-11-29T05:58:04,549   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,550   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,554   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,556   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,559   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,562   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,565   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,567   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,570   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-11-29T05:58:04,573   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:04,575   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:04,577   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:04,580   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:04,582   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:04,585   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-11-29T05:58:04,588   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:58:04,589   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:58:04,592   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:58:04,595   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:58:04,598   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-11-29T05:58:04,600   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-11-29T05:58:04,602   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-11-29T05:58:04,605   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-11-29T05:58:04,607   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-11-29T05:58:04,611   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:04,612   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:04,616   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:04,619   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:04,621   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:04,624   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:04,626   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-11-29T05:58:04,628   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-11-29T05:58:04,630   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-11-29T05:58:04,632   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:04,634   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:04,636   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:04,639   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:04,641   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:04,644   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:04,646   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-11-29T05:58:04,650   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:58:04,652   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:58:04,655   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:58:04,659   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:58:04,663   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-11-29T05:58:04,667   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:04,669   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:04,672   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:04,676   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:04,679   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:04,682   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:04,685   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-11-29T05:58:04,688   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,690   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,692   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,695   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,698   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,700   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,702   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,704   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,707   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-11-29T05:58:04,710   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:04,712   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:04,715   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:04,717   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:04,719   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:04,722   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:04,724   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-11-29T05:58:04,727   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:04,729   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:04,731   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:04,734   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:04,736   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:04,738   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:04,740   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-11-29T05:58:04,743   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:04,745   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:04,747   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:04,749   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:04,752   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:04,754   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:04,756   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-11-29T05:58:04,758   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-11-29T05:58:04,761   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-29T05:58:04,762   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-29T05:58:04,765   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-29T05:58:04,767   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-11-29T05:58:04,769   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-11-29T05:58:04,771   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-11-29T05:58:04,775   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-11-29T05:58:04,776   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-11-29T05:58:04,779   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-11-29T05:58:04,782   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-11-29T05:58:04,783   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-29T05:58:04,786   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-29T05:58:04,788   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-29T05:58:04,790   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-29T05:58:04,792   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-29T05:58:04,795   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-29T05:58:04,796   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-11-29T05:58:04,799   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,800   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,803   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,805   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,807   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,809   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,811   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,813   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,815   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-11-29T05:58:04,818   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-11-29T05:58:04,820   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-11-29T05:58:04,822   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-11-29T05:58:04,825   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-11-29T05:58:04,826   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-11-29T05:58:04,829   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-11-29T05:58:04,830   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-11-29T05:58:04,833   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-11-29T05:58:04,835   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-11-29T05:58:04,837   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-11-29T05:58:04,839   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-11-29T05:58:04,841   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-11-29T05:58:04,842   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-11-29T05:58:04,845   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-11-29T05:58:04,847   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-11-29T05:58:04,849   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-11-29T05:58:04,851   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-11-29T05:58:04,853   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-11-29T05:58:04,856   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-11-29T05:58:04,857   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-11-29T05:58:04,859   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-11-29T05:58:04,862   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-29T05:58:04,863   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-29T05:58:04,866   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-29T05:58:04,867   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-11-29T05:58:04,869   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-11-29T05:58:04,871   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-11-29T05:58:04,873   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-11-29T05:58:04,875   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-11-29T05:58:04,878   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-11-29T05:58:04,879   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,882   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,884   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,887   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,890   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,892   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,894   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,896   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,898   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,900   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-11-29T05:58:04,903   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-11-29T05:58:04,904   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2024-11-29T05:58:04,906   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2024-11-29T05:58:04,908   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2024-11-29T05:58:04,910   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:04,913   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-11-29T05:58:04,914   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-11-29T05:58:04,917   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-11-29T05:58:04,919   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-11-29T05:58:04,921   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:04,925   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-11-29T05:58:04,926   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,928   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,933   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,936   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,940   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,942   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,948   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,950   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,952   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,955   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,957   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,959   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,962   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,964   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,967   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,969   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,971   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-11-29T05:58:04,974   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:04,976   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:04,978   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:04,981   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:04,987   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:04,989   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-11-29T05:58:04,990   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-11-29T05:58:04,992   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-11-29T05:58:04,995   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-11-29T05:58:04,996   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-11-29T05:58:04,999   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:58:05,001   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:58:05,003   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:58:05,006   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:58:05,008   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:58:05,010   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-11-29T05:58:05,012   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-11-29T05:58:05,015   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-11-29T05:58:05,017   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-11-29T05:58:05,019   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:58:05,021   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:58:05,024   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:58:05,027   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:58:05,029   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:58:05,032   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-11-29T05:58:05,034   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,037   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,039   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,042   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,044   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,046   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,049   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-11-29T05:58:05,050   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-11-29T05:58:05,053   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-11-29T05:58:05,056   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-11-29T05:58:05,059   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-11-29T05:58:05,060   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-11-29T05:58:05,064   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-11-29T05:58:05,067   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-11-29T05:58:05,070   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-11-29T05:58:05,071   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-11-29T05:58:05,074   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-11-29T05:58:05,075   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-29T05:58:05,078   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-29T05:58:05,082   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-29T05:58:05,085   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-29T05:58:05,088   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-29T05:58:05,090   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-11-29T05:58:05,093   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-11-29T05:58:05,095   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-11-29T05:58:05,097   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-11-29T05:58:05,099   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-11-29T05:58:05,102   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-11-29T05:58:05,104   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,107   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,111   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,113   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,116   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,120   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,122   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,125   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,127   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,130   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,133   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,135   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-11-29T05:58:05,138   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-11-29T05:58:05,140   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-29T05:58:05,143   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-29T05:58:05,146   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-29T05:58:05,148   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-29T05:58:05,151   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-29T05:58:05,154   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-11-29T05:58:05,156   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,159   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,162   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-11-29T05:58:05,165   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-11-29T05:58:05,166   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-11-29T05:58:05,168   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-11-29T05:58:05,170   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-11-29T05:58:05,173   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-11-29T05:58:05,174   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-29T05:58:05,177   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-29T05:58:05,179   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-29T05:58:05,181   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-29T05:58:05,183   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-11-29T05:58:05,185   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2024-11-29T05:58:05,186   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,188   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,191   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,193   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,195   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,197   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,199   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,201   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,203   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,205   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,207   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,209   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2024-11-29T05:58:05,211   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-11-29T05:58:05,213   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-11-29T05:58:05,214   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-29T05:58:05,216   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-29T05:58:05,218   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-29T05:58:05,221   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-29T05:58:05,224   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-29T05:58:05,226   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-11-29T05:58:05,227   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-29T05:58:05,230   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-11-29T05:58:05,231   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-11-29T05:58:05,234   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-11-29T05:58:05,236   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-11-29T05:58:05,238   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-11-29T05:58:05,240   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-29T05:58:05,243   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-29T05:58:05,245   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-29T05:58:05,246   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-29T05:58:05,249   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-11-29T05:58:05,252   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-29T05:58:05,255   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-11-29T05:58:05,256   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-29T05:58:05,258   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-29T05:58:05,261   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-29T05:58:05,264   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-29T05:58:05,266   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-29T05:58:05,268   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-29T05:58:05,271   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-29T05:58:05,273   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-11-29T05:58:05,276   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-11-29T05:58:05,278   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-11-29T05:58:05,279   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-11-29T05:58:05,281   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-11-29T05:58:05,284   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-11-29T05:58:05,287   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-11-29T05:58:05,289   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-11-29T05:58:05,291   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-11-29T05:58:05,292   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,295   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,298   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,300   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,302   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,304   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,306   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,309   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,311   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,314   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,316   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,319   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,320   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,323   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,325   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,327   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,329   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,331   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-11-29T05:58:05,335   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-11-29T05:58:05,337   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-11-29T05:58:05,339   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-11-29T05:58:05,342   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-11-29T05:58:05,346   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-11-29T05:58:05,347   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-29T05:58:05,352   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-29T05:58:05,356   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-29T05:58:05,358   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-29T05:58:05,362   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-29T05:58:05,365   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-29T05:58:05,368   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-11-29T05:58:05,372   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:58:05,374   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:58:05,377   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:58:05,379   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:58:05,382   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-11-29T05:58:05,386   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-11-29T05:58:05,388   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,391   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,394   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,397   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,400   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2024-11-29T05:58:05,402   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-29T05:58:05,404   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-29T05:58:05,407   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-29T05:58:05,410   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-29T05:58:05,412   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-29T05:58:05,415   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2024-11-29T05:58:05,417   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,420   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-11-29T05:58:05,422   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-29T05:58:05,425   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-29T05:58:05,427   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-29T05:58:05,430   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-29T05:58:05,432   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-29T05:58:05,434   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-11-29T05:58:05,436   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,438   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,439   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,441   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,443   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,445   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,448   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,449   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,451   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,454   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,455   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,457   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,459   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,461   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,463   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,465   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,467   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-11-29T05:58:05,470   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,471   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,474   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,476   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,477   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,479   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,481   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,483   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,485   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,487   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-11-29T05:58:05,489   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,491   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,493   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,495   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,497   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,500   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-11-29T05:58:05,501   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-29T05:58:05,503   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-29T05:58:05,505   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-29T05:58:05,507   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-29T05:58:05,508   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-29T05:58:05,510   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-29T05:58:05,512   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-11-29T05:58:05,514   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,517   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,519   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,521   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,522   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,524   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,526   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,528   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-11-29T05:58:05,531   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-11-29T05:58:05,532   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-11-29T05:58:05,534   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-11-29T05:58:05,537   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-11-29T05:58:05,538   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-11-29T05:58:05,540   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-11-29T05:58:05,542   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-11-29T05:58:05,545   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:05,546   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:05,548   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:05,553   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-29T05:58:05,555   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-29T05:58:05,557   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-11-29T05:58:05,559   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:05,562   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:05,565   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:05,566   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:05,570   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:05,572   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:05,575   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:05,577   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:05,581   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:05,583   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-11-29T05:58:05,586   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:05,590   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:05,591   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:05,594   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:05,596   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:05,599   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-11-29T05:58:05,602   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:05,603   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:05,606   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:05,608   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:05,612   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:05,615   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:05,618   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:05,620   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-11-29T05:58:05,623   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-11-29T05:58:05,626   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-11-29T05:58:05,627   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-11-29T05:58:05,631   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-11-29T05:58:05,632   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,634   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,636   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,638   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,640   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,642   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,644   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,646   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,648   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,651   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,653   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,655   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,657   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,659   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,661   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,663   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,665   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,667   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,670   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,672   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,674   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,677   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,679   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,680   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,682   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,684   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,687   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,689   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,691   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-11-29T05:58:05,693   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-11-29T05:58:05,695   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-11-29T05:58:05,696   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-11-29T05:58:05,699   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-11-29T05:58:05,700   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-11-29T05:58:05,703   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-11-29T05:58:05,705   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-11-29T05:58:05,707   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,708   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,711   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,713   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,715   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,717   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,719   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,721   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,723   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,725   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,727   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,729   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,731   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,733   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,735   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,737   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,739   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,741   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-11-29T05:58:05,744   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-11-29T05:58:05,746   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-11-29T05:58:05,748   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-11-29T05:58:05,749   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-29T05:58:05,752   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-29T05:58:05,754   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-29T05:58:05,756   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-29T05:58:05,758   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-29T05:58:05,761   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-11-29T05:58:05,764   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-11-29T05:58:05,765   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-29T05:58:05,768   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-29T05:58:05,770   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-29T05:58:05,773   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-29T05:58:05,775   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-29T05:58:05,778   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-29T05:58:05,780   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-11-29T05:58:05,783   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-11-29T05:58:05,784   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-11-29T05:58:05,787   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-11-29T05:58:05,789   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-11-29T05:58:05,790   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-11-29T05:58:05,798   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:05,799   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:05,802   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:05,804   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:05,807   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:05,809   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-11-29T05:58:05,812   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-11-29T05:58:05,813   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-11-29T05:58:05,815   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-11-29T05:58:05,817   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-11-29T05:58:05,820   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-11-29T05:58:05,821   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-11-29T05:58:05,824   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-11-29T05:58:05,825   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-11-29T05:58:05,828   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-11-29T05:58:05,829   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-29T05:58:05,831   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-29T05:58:05,834   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-29T05:58:05,836   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-29T05:58:05,838   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-11-29T05:58:05,840   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-11-29T05:58:05,842   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-11-29T05:58:05,843   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-11-29T05:58:05,846   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:05,848   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:05,850   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:05,853   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:05,854   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-11-29T05:58:05,858   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-11-29T05:58:05,859   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-11-29T05:58:05,862   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-11-29T05:58:05,863   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-11-29T05:58:05,865   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-11-29T05:58:05,867   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-11-29T05:58:05,869   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-11-29T05:58:05,871   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-11-29T05:58:05,874   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-11-29T05:58:05,875   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-11-29T05:58:05,878   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-11-29T05:58:05,880   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-11-29T05:58:05,882   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-11-29T05:58:05,885   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2024-11-29T05:58:05,887   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:05,888   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:05,891   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:05,894   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:05,895   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:05,897   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:05,899   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-11-29T05:58:05,902   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-11-29T05:58:05,903   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-29T05:58:05,905   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-29T05:58:05,907   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-29T05:58:05,910   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-29T05:58:05,912   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-11-29T05:58:05,914   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,915   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,918   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,922   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-11-29T05:58:05,924   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-11-29T05:58:05,925   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-11-29T05:58:05,928   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-11-29T05:58:05,930   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-11-29T05:58:05,934   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,935   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,937   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,940   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,942   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,946   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,948   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,951   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,953   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,956   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,958   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-11-29T05:58:05,960   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,963   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,965   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,968   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,972   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,975   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-11-29T05:58:05,978   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:05,979   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:05,982   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:05,984   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:05,986   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-11-29T05:58:05,989   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-11-29T05:58:05,991   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-11-29T05:58:05,993   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-11-29T05:58:05,995   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-11-29T05:58:05,998   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-11-29T05:58:06,000   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-11-29T05:58:06,001   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-11-29T05:58:06,004   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-11-29T05:58:06,006   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-11-29T05:58:06,008   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-11-29T05:58:06,009   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-11-29T05:58:06,012   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-11-29T05:58:06,014   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-11-29T05:58:06,015   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-11-29T05:58:06,018   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-11-29T05:58:06,019   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-11-29T05:58:06,022   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2024-11-29T05:58:06,023   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2024-11-29T05:58:06,026   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-11-29T05:58:06,027   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-11-29T05:58:06,029   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-11-29T05:58:06,031   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-11-29T05:58:06,033   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-11-29T05:58:06,036   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-11-29T05:58:06,037   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-11-29T05:58:06,040   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-11-29T05:58:06,041   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,043   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,045   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,048   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,051   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,052   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,054   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,056   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,058   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,060   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,062   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,064   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,065   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,067   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,069   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,071   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,073   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,075   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,077   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,078   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,080   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,082   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,084   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,086   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,088   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,090   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,092   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,094   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-11-29T05:58:06,097   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,100   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,101   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,104   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,106   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,107   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,109   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,112   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,114   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,116   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,118   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,120   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-11-29T05:58:06,123   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,125   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,127   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,129   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,132   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-11-29T05:58:06,133   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-11-29T05:58:06,136   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-11-29T05:58:06,138   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-11-29T05:58:06,141   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-11-29T05:58:06,144   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-11-29T05:58:06,145   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-11-29T05:58:06,149   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-11-29T05:58:06,151   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-11-29T05:58:06,155   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-11-29T05:58:06,156   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-29T05:58:06,159   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-29T05:58:06,161   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-29T05:58:06,164   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-29T05:58:06,167   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-29T05:58:06,170   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-11-29T05:58:06,172   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-29T05:58:06,175   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-11-29T05:58:06,176   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-11-29T05:58:06,180   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-11-29T05:58:06,181   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,184   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,187   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,189   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,192   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,195   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,197   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,200   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,202   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,205   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-11-29T05:58:06,209   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-11-29T05:58:06,210   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-29T05:58:06,213   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-29T05:58:06,215   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-29T05:58:06,217   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-29T05:58:06,219   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-29T05:58:06,222   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-29T05:58:06,224   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-29T05:58:06,227   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-11-29T05:58:06,229   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-29T05:58:06,232   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-11-29T05:58:06,234   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,237   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,239   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,241   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,242   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,244   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,246   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,248   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,250   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-11-29T05:58:06,253   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-29T05:58:06,254   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-11-29T05:58:06,258   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-11-29T05:58:06,259   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,262   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-11-29T05:58:06,263   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,266   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,268   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,271   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,273   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,275   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,278   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,280   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,281   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,283   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,286   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,288   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,290   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,292   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,294   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,296   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-11-29T05:58:06,298   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-29T05:58:06,300   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-29T05:58:06,302   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-29T05:58:06,304   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-29T05:58:06,306   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-29T05:58:06,308   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-29T05:58:06,310   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-11-29T05:58:06,312   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,313   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,315   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,317   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-11-29T05:58:06,319   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,321   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,323   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,326   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,327   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,330   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,332   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,334   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,337   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,338   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,341   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,342   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-11-29T05:58:06,345   running install_egg_info
2024-11-29T05:58:06,379   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.0-py3.11.egg-info
2024-11-29T05:58:06,404   running install_scripts
2024-11-29T05:58:06,406   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,410   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,414   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,418   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,420   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,422   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,424   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,426   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,427   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,429   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,431   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts
2024-11-29T05:58:06,432   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/ds_ssh to 755
2024-11-29T05:58:06,433   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/ds to 755
2024-11-29T05:58:06,433   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/ds_report to 755
2024-11-29T05:58:06,433   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/ds_nvme_tune to 755
2024-11-29T05:58:06,434   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/dsr to 755
2024-11-29T05:58:06,434   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/ds_io to 755
2024-11-29T05:58:06,435   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/ds_bench to 755
2024-11-29T05:58:06,435   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/ds_elastic to 755
2024-11-29T05:58:06,436   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/deepspeed to 755
2024-11-29T05:58:06,436   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.data/scripts/deepspeed.pt to 755
2024-11-29T05:58:06,484   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.0.dist-info/WHEEL
2024-11-29T05:58:06,486   creating '/tmp/pip-wheel-a2moo2n5/deepspeed-0.16.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-11-29T05:58:06,489   adding 'deepspeed/__init__.py'
2024-11-29T05:58:06,491   adding 'deepspeed/constants.py'
2024-11-29T05:58:06,493   adding 'deepspeed/env_report.py'
2024-11-29T05:58:06,494   adding 'deepspeed/git_version_info.py'
2024-11-29T05:58:06,495   adding 'deepspeed/git_version_info_installed.py'
2024-11-29T05:58:06,497   adding 'deepspeed/accelerator/__init__.py'
2024-11-29T05:58:06,499   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-11-29T05:58:06,500   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-11-29T05:58:06,503   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-11-29T05:58:06,504   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-11-29T05:58:06,506   adding 'deepspeed/accelerator/mlu_accelerator.py'
2024-11-29T05:58:06,508   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-11-29T05:58:06,510   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-11-29T05:58:06,511   adding 'deepspeed/accelerator/real_accelerator.py'
2024-11-29T05:58:06,513   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-11-29T05:58:06,515   adding 'deepspeed/autotuning/__init__.py'
2024-11-29T05:58:06,520   adding 'deepspeed/autotuning/autotuner.py'
2024-11-29T05:58:06,522   adding 'deepspeed/autotuning/config.py'
2024-11-29T05:58:06,523   adding 'deepspeed/autotuning/constants.py'
2024-11-29T05:58:06,526   adding 'deepspeed/autotuning/scheduler.py'
2024-11-29T05:58:06,528   adding 'deepspeed/autotuning/utils.py'
2024-11-29T05:58:06,530   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-11-29T05:58:06,532   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-11-29T05:58:06,533   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-11-29T05:58:06,534   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-11-29T05:58:06,536   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-11-29T05:58:06,538   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-11-29T05:58:06,539   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-11-29T05:58:06,540   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-11-29T05:58:06,542   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-11-29T05:58:06,543   adding 'deepspeed/autotuning/tuner/utils.py'
2024-11-29T05:58:06,546   adding 'deepspeed/checkpoint/__init__.py'
2024-11-29T05:58:06,547   adding 'deepspeed/checkpoint/constants.py'
2024-11-29T05:58:06,549   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-11-29T05:58:06,552   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-11-29T05:58:06,554   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-11-29T05:58:06,555   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-11-29T05:58:06,557   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-11-29T05:58:06,558   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-11-29T05:58:06,560   adding 'deepspeed/checkpoint/utils.py'
2024-11-29T05:58:06,562   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-11-29T05:58:06,563   adding 'deepspeed/comm/__init__.py'
2024-11-29T05:58:06,565   adding 'deepspeed/comm/backend.py'
2024-11-29T05:58:06,566   adding 'deepspeed/comm/ccl.py'
2024-11-29T05:58:06,570   adding 'deepspeed/comm/comm.py'
2024-11-29T05:58:06,571   adding 'deepspeed/comm/config.py'
2024-11-29T05:58:06,573   adding 'deepspeed/comm/constants.py'
2024-11-29T05:58:06,575   adding 'deepspeed/comm/reduce_op.py'
2024-11-29T05:58:06,577   adding 'deepspeed/comm/torch.py'
2024-11-29T05:58:06,579   adding 'deepspeed/comm/utils.py'
2024-11-29T05:58:06,582   adding 'deepspeed/compression/__init__.py'
2024-11-29T05:58:06,585   adding 'deepspeed/compression/basic_layer.py'
2024-11-29T05:58:06,587   adding 'deepspeed/compression/compress.py'
2024-11-29T05:58:06,589   adding 'deepspeed/compression/config.py'
2024-11-29T05:58:06,591   adding 'deepspeed/compression/constants.py'
2024-11-29T05:58:06,593   adding 'deepspeed/compression/helper.py'
2024-11-29T05:58:06,595   adding 'deepspeed/compression/scheduler.py'
2024-11-29T05:58:06,596   adding 'deepspeed/compression/utils.py'
2024-11-29T05:58:06,598   adding 'deepspeed/elasticity/__init__.py'
2024-11-29T05:58:06,600   adding 'deepspeed/elasticity/config.py'
2024-11-29T05:58:06,601   adding 'deepspeed/elasticity/constants.py'
2024-11-29T05:58:06,603   adding 'deepspeed/elasticity/elastic_agent.py'
2024-11-29T05:58:06,605   adding 'deepspeed/elasticity/elasticity.py'
2024-11-29T05:58:06,606   adding 'deepspeed/elasticity/utils.py'
2024-11-29T05:58:06,608   adding 'deepspeed/inference/__init__.py'
2024-11-29T05:58:06,610   adding 'deepspeed/inference/config.py'
2024-11-29T05:58:06,614   adding 'deepspeed/inference/engine.py'
2024-11-29T05:58:06,616   adding 'deepspeed/inference/quantization/__init__.py'
2024-11-29T05:58:06,618   adding 'deepspeed/inference/quantization/layers.py'
2024-11-29T05:58:06,619   adding 'deepspeed/inference/quantization/quantization.py'
2024-11-29T05:58:06,620   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-11-29T05:58:06,622   adding 'deepspeed/inference/quantization/utils.py'
2024-11-29T05:58:06,625   adding 'deepspeed/inference/v2/__init__.py'
2024-11-29T05:58:06,626   adding 'deepspeed/inference/v2/allocator.py'
2024-11-29T05:58:06,627   adding 'deepspeed/inference/v2/config_v2.py'
2024-11-29T05:58:06,629   adding 'deepspeed/inference/v2/engine_factory.py'
2024-11-29T05:58:06,631   adding 'deepspeed/inference/v2/engine_v2.py'
2024-11-29T05:58:06,633   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-11-29T05:58:06,634   adding 'deepspeed/inference/v2/inference_utils.py'
2024-11-29T05:58:06,636   adding 'deepspeed/inference/v2/logging.py'
2024-11-29T05:58:06,637   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-11-29T05:58:06,639   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-11-29T05:58:06,640   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-11-29T05:58:06,642   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-11-29T05:58:06,643   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-11-29T05:58:06,645   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-11-29T05:58:06,647   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-11-29T05:58:06,648   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-11-29T05:58:06,650   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-11-29T05:58:06,651   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-11-29T05:58:06,653   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-11-29T05:58:06,654   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-11-29T05:58:06,655   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-11-29T05:58:06,657   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-11-29T05:58:06,658   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-11-29T05:58:06,660   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-11-29T05:58:06,661   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-11-29T05:58:06,663   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-11-29T05:58:06,665   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-11-29T05:58:06,666   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-11-29T05:58:06,668   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-11-29T05:58:06,670   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-11-29T05:58:06,671   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-11-29T05:58:06,672   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-11-29T05:58:06,674   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-11-29T05:58:06,676   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-11-29T05:58:06,678   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-11-29T05:58:06,680   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-11-29T05:58:06,682   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-11-29T05:58:06,683   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-11-29T05:58:06,685   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-11-29T05:58:06,686   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-11-29T05:58:06,688   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-11-29T05:58:06,690   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-11-29T05:58:06,692   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-11-29T05:58:06,693   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-11-29T05:58:06,695   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-11-29T05:58:06,696   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-11-29T05:58:06,698   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-11-29T05:58:06,699   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-11-29T05:58:06,701   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-11-29T05:58:06,703   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-11-29T05:58:06,704   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-11-29T05:58:06,706   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-11-29T05:58:06,707   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-11-29T05:58:06,709   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-11-29T05:58:06,711   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-11-29T05:58:06,712   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-11-29T05:58:06,714   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-11-29T05:58:06,716   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-11-29T05:58:06,717   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-11-29T05:58:06,718   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-11-29T05:58:06,720   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-11-29T05:58:06,722   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-11-29T05:58:06,723   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-11-29T05:58:06,725   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-11-29T05:58:06,726   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-11-29T05:58:06,727   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-11-29T05:58:06,729   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-11-29T05:58:06,730   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-11-29T05:58:06,732   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-11-29T05:58:06,733   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-11-29T05:58:06,734   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-11-29T05:58:06,736   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-11-29T05:58:06,737   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-11-29T05:58:06,738   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-11-29T05:58:06,740   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-11-29T05:58:06,742   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-11-29T05:58:06,743   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-11-29T05:58:06,745   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-11-29T05:58:06,747   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-11-29T05:58:06,750   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-11-29T05:58:06,752   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-11-29T05:58:06,753   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-11-29T05:58:06,755   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-11-29T05:58:06,756   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-11-29T05:58:06,758   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-11-29T05:58:06,759   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-11-29T05:58:06,761   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-11-29T05:58:06,762   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-11-29T05:58:06,764   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-11-29T05:58:06,765   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-11-29T05:58:06,766   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-11-29T05:58:06,768   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-11-29T05:58:06,770   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-11-29T05:58:06,771   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-11-29T05:58:06,772   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-11-29T05:58:06,773   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-11-29T05:58:06,775   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-11-29T05:58:06,776   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-11-29T05:58:06,778   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-11-29T05:58:06,780   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-11-29T05:58:06,782   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-11-29T05:58:06,783   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-11-29T05:58:06,784   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-11-29T05:58:06,786   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-11-29T05:58:06,792   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-11-29T05:58:06,794   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-11-29T05:58:06,795   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-11-29T05:58:06,797   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-11-29T05:58:06,798   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-11-29T05:58:06,799   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-11-29T05:58:06,801   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-11-29T05:58:06,802   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-11-29T05:58:06,804   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-11-29T05:58:06,806   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-11-29T05:58:06,807   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-11-29T05:58:06,808   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-11-29T05:58:06,810   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-11-29T05:58:06,811   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-11-29T05:58:06,813   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-11-29T05:58:06,815   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-11-29T05:58:06,816   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-11-29T05:58:06,818   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-11-29T05:58:06,819   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-11-29T05:58:06,820   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-11-29T05:58:06,823   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-11-29T05:58:06,825   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-11-29T05:58:06,826   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-11-29T05:58:06,827   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-11-29T05:58:06,829   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-11-29T05:58:06,830   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-11-29T05:58:06,831   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-11-29T05:58:06,833   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-11-29T05:58:06,834   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-11-29T05:58:06,836   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-11-29T05:58:06,838   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-11-29T05:58:06,839   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-11-29T05:58:06,841   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-11-29T05:58:06,843   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-11-29T05:58:06,845   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-11-29T05:58:06,848   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-11-29T05:58:06,850   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-11-29T05:58:06,852   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-11-29T05:58:06,854   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-11-29T05:58:06,855   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-11-29T05:58:06,856   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-11-29T05:58:06,858   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-11-29T05:58:06,860   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-11-29T05:58:06,861   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-11-29T05:58:06,863   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-11-29T05:58:06,865   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-11-29T05:58:06,867   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-11-29T05:58:06,869   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-11-29T05:58:06,870   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-11-29T05:58:06,871   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-11-29T05:58:06,873   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-11-29T05:58:06,875   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-11-29T05:58:06,876   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-11-29T05:58:06,878   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-11-29T05:58:06,880   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-11-29T05:58:06,881   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-11-29T05:58:06,883   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-11-29T05:58:06,884   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-11-29T05:58:06,886   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-11-29T05:58:06,887   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-11-29T05:58:06,889   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-11-29T05:58:06,890   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-11-29T05:58:06,892   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-11-29T05:58:06,894   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-11-29T05:58:06,895   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-11-29T05:58:06,897   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-11-29T05:58:06,900   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-11-29T05:58:06,902   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-11-29T05:58:06,903   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-11-29T05:58:06,905   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-11-29T05:58:06,906   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-11-29T05:58:06,908   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-11-29T05:58:06,909   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-11-29T05:58:06,911   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-11-29T05:58:06,912   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-11-29T05:58:06,914   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-11-29T05:58:06,915   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-11-29T05:58:06,916   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-11-29T05:58:06,918   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-11-29T05:58:06,919   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-11-29T05:58:06,921   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-11-29T05:58:06,922   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-11-29T05:58:06,924   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-11-29T05:58:06,925   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-11-29T05:58:06,927   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-11-29T05:58:06,928   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-11-29T05:58:06,930   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-11-29T05:58:06,931   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-11-29T05:58:06,933   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-11-29T05:58:06,934   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-11-29T05:58:06,935   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-11-29T05:58:06,937   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-11-29T05:58:06,938   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-11-29T05:58:06,940   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-11-29T05:58:06,942   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-11-29T05:58:06,944   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-11-29T05:58:06,946   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-11-29T05:58:06,948   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-11-29T05:58:06,950   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-11-29T05:58:06,952   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-11-29T05:58:06,954   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-11-29T05:58:06,956   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-11-29T05:58:06,958   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-11-29T05:58:06,959   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-11-29T05:58:06,961   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-11-29T05:58:06,962   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-11-29T05:58:06,965   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-11-29T05:58:06,967   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-11-29T05:58:06,969   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-11-29T05:58:06,971   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-11-29T05:58:06,973   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-11-29T05:58:06,975   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-11-29T05:58:06,977   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-11-29T05:58:06,979   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-11-29T05:58:06,981   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-11-29T05:58:06,983   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-11-29T05:58:06,985   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-11-29T05:58:06,987   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-11-29T05:58:06,989   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-11-29T05:58:06,990   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-11-29T05:58:06,992   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-11-29T05:58:06,994   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-11-29T05:58:06,996   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-11-29T05:58:06,998   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-11-29T05:58:07,000   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-11-29T05:58:07,002   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-11-29T05:58:07,003   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-11-29T05:58:07,005   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-11-29T05:58:07,007   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-11-29T05:58:07,008   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-11-29T05:58:07,010   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-11-29T05:58:07,013   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-11-29T05:58:07,015   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-11-29T05:58:07,017   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-11-29T05:58:07,019   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-11-29T05:58:07,021   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-11-29T05:58:07,024   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-11-29T05:58:07,027   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-11-29T05:58:07,029   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-11-29T05:58:07,030   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-11-29T05:58:07,033   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-11-29T05:58:07,035   adding 'deepspeed/launcher/__init__.py'
2024-11-29T05:58:07,036   adding 'deepspeed/launcher/constants.py'
2024-11-29T05:58:07,040   adding 'deepspeed/launcher/launch.py'
2024-11-29T05:58:07,042   adding 'deepspeed/launcher/launcher_helper.py'
2024-11-29T05:58:07,044   adding 'deepspeed/launcher/multinode_runner.py'
2024-11-29T05:58:07,047   adding 'deepspeed/launcher/runner.py'
2024-11-29T05:58:07,050   adding 'deepspeed/linear/__init__.py'
2024-11-29T05:58:07,051   adding 'deepspeed/linear/config.py'
2024-11-29T05:58:07,052   adding 'deepspeed/linear/context_manager.py'
2024-11-29T05:58:07,054   adding 'deepspeed/linear/optimized_linear.py'
2024-11-29T05:58:07,056   adding 'deepspeed/linear/quantization.py'
2024-11-29T05:58:07,058   adding 'deepspeed/model_implementations/__init__.py'
2024-11-29T05:58:07,059   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-11-29T05:58:07,061   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-11-29T05:58:07,062   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-11-29T05:58:07,064   adding 'deepspeed/model_implementations/features/__init__.py'
2024-11-29T05:58:07,065   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-11-29T05:58:07,066   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-11-29T05:58:07,068   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-11-29T05:58:07,069   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-11-29T05:58:07,070   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-11-29T05:58:07,071   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-11-29T05:58:07,073   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-11-29T05:58:07,074   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-11-29T05:58:07,075   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-11-29T05:58:07,076   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-11-29T05:58:07,078   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-11-29T05:58:07,079   adding 'deepspeed/module_inject/__init__.py'
2024-11-29T05:58:07,082   adding 'deepspeed/module_inject/auto_tp.py'
2024-11-29T05:58:07,084   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-11-29T05:58:07,085   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-11-29T05:58:07,087   adding 'deepspeed/module_inject/inject.py'
2024-11-29T05:58:07,088   adding 'deepspeed/module_inject/layers.py'
2024-11-29T05:58:07,090   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-11-29T05:58:07,092   adding 'deepspeed/module_inject/module_quantize.py'
2024-11-29T05:58:07,094   adding 'deepspeed/module_inject/policy.py'
2024-11-29T05:58:07,097   adding 'deepspeed/module_inject/replace_module.py'
2024-11-29T05:58:07,099   adding 'deepspeed/module_inject/replace_policy.py'
2024-11-29T05:58:07,100   adding 'deepspeed/module_inject/tp_shard.py'
2024-11-29T05:58:07,101   adding 'deepspeed/module_inject/utils.py'
2024-11-29T05:58:07,103   adding 'deepspeed/module_inject/containers/__init__.py'
2024-11-29T05:58:07,105   adding 'deepspeed/module_inject/containers/base.py'
2024-11-29T05:58:07,107   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-11-29T05:58:07,108   adding 'deepspeed/module_inject/containers/bert.py'
2024-11-29T05:58:07,110   adding 'deepspeed/module_inject/containers/bloom.py'
2024-11-29T05:58:07,111   adding 'deepspeed/module_inject/containers/clip.py'
2024-11-29T05:58:07,112   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-11-29T05:58:07,114   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-11-29T05:58:07,115   adding 'deepspeed/module_inject/containers/gptj.py'
2024-11-29T05:58:07,117   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-11-29T05:58:07,118   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-11-29T05:58:07,120   adding 'deepspeed/module_inject/containers/internlm.py'
2024-11-29T05:58:07,121   adding 'deepspeed/module_inject/containers/llama.py'
2024-11-29T05:58:07,123   adding 'deepspeed/module_inject/containers/llama2.py'
2024-11-29T05:58:07,124   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-11-29T05:58:07,126   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-11-29T05:58:07,127   adding 'deepspeed/module_inject/containers/opt.py'
2024-11-29T05:58:07,128   adding 'deepspeed/module_inject/containers/unet.py'
2024-11-29T05:58:07,130   adding 'deepspeed/module_inject/containers/vae.py'
2024-11-29T05:58:07,132   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-11-29T05:58:07,133   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-11-29T05:58:07,135   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-11-29T05:58:07,136   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-11-29T05:58:07,137   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-11-29T05:58:07,139   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-11-29T05:58:07,140   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-11-29T05:58:07,142   adding 'deepspeed/moe/__init__.py'
2024-11-29T05:58:07,143   adding 'deepspeed/moe/experts.py'
2024-11-29T05:58:07,145   adding 'deepspeed/moe/layer.py'
2024-11-29T05:58:07,146   adding 'deepspeed/moe/mappings.py'
2024-11-29T05:58:07,149   adding 'deepspeed/moe/sharded_moe.py'
2024-11-29T05:58:07,151   adding 'deepspeed/moe/utils.py'
2024-11-29T05:58:07,153   adding 'deepspeed/monitor/__init__.py'
2024-11-29T05:58:07,154   adding 'deepspeed/monitor/comet.py'
2024-11-29T05:58:07,155   adding 'deepspeed/monitor/config.py'
2024-11-29T05:58:07,157   adding 'deepspeed/monitor/csv_monitor.py'
2024-11-29T05:58:07,158   adding 'deepspeed/monitor/monitor.py'
2024-11-29T05:58:07,159   adding 'deepspeed/monitor/tensorboard.py'
2024-11-29T05:58:07,161   adding 'deepspeed/monitor/utils.py'
2024-11-29T05:58:07,162   adding 'deepspeed/monitor/wandb.py'
2024-11-29T05:58:07,164   adding 'deepspeed/nebula/__init__.py'
2024-11-29T05:58:07,165   adding 'deepspeed/nebula/config.py'
2024-11-29T05:58:07,167   adding 'deepspeed/nebula/constants.py'
2024-11-29T05:58:07,169   adding 'deepspeed/nvme/__init__.py'
2024-11-29T05:58:07,170   adding 'deepspeed/nvme/ds_aio_args.py'
2024-11-29T05:58:07,172   adding 'deepspeed/nvme/ds_aio_basic.py'
2024-11-29T05:58:07,173   adding 'deepspeed/nvme/ds_aio_handle.py'
2024-11-29T05:58:07,174   adding 'deepspeed/nvme/ds_aio_job.py'
2024-11-29T05:58:07,176   adding 'deepspeed/nvme/parse_nvme_stats.py'
2024-11-29T05:58:07,177   adding 'deepspeed/nvme/perf_generate_param.py'
2024-11-29T05:58:07,179   adding 'deepspeed/nvme/perf_run_sweep.py'
2024-11-29T05:58:07,180   adding 'deepspeed/nvme/perf_sweep_utils.py'
2024-11-29T05:58:07,181   adding 'deepspeed/nvme/test_ds_aio.py'
2024-11-29T05:58:07,182   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2024-11-29T05:58:07,183   adding 'deepspeed/nvme/validate_async_io.py'
2024-11-29T05:58:07,185   adding 'deepspeed/ops/__init__.py'
2024-11-29T05:58:07,187   adding 'deepspeed/ops/adagrad/__init__.py'
2024-11-29T05:58:07,188   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-11-29T05:58:07,190   adding 'deepspeed/ops/adam/__init__.py'
2024-11-29T05:58:07,192   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-11-29T05:58:07,193   adding 'deepspeed/ops/adam/fused_adam.py'
2024-11-29T05:58:07,195   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-11-29T05:58:07,196   adding 'deepspeed/ops/aio/__init__.py'
2024-11-29T05:58:07,199   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-11-29T05:58:07,201   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-11-29T05:58:07,202   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-11-29T05:58:07,203   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-11-29T05:58:07,205   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-11-29T05:58:07,206   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-11-29T05:58:07,209   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-11-29T05:58:07,210   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-11-29T05:58:07,212   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-11-29T05:58:07,213   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-11-29T05:58:07,215   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-11-29T05:58:07,216   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-11-29T05:58:07,219   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2024-11-29T05:58:07,220   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2024-11-29T05:58:07,221   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-11-29T05:58:07,222   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-11-29T05:58:07,223   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2024-11-29T05:58:07,225   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2024-11-29T05:58:07,226   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-11-29T05:58:07,227   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-11-29T05:58:07,229   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-11-29T05:58:07,230   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-11-29T05:58:07,231   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-11-29T05:58:07,233   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-11-29T05:58:07,234   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-11-29T05:58:07,235   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-11-29T05:58:07,237   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2024-11-29T05:58:07,238   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2024-11-29T05:58:07,240   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-11-29T05:58:07,241   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-11-29T05:58:07,244   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-11-29T05:58:07,246   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-11-29T05:58:07,249   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-11-29T05:58:07,251   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-11-29T05:58:07,252   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-11-29T05:58:07,254   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-11-29T05:58:07,256   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-11-29T05:58:07,258   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-11-29T05:58:07,260   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-11-29T05:58:07,262   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-11-29T05:58:07,269   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-11-29T05:58:07,274   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-11-29T05:58:07,277   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-11-29T05:58:07,279   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-11-29T05:58:07,281   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-11-29T05:58:07,283   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-11-29T05:58:07,285   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-11-29T05:58:07,287   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-11-29T05:58:07,290   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-11-29T05:58:07,292   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-11-29T05:58:07,294   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-11-29T05:58:07,296   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-11-29T05:58:07,304   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-11-29T05:58:07,307   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-11-29T05:58:07,309   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-11-29T05:58:07,313   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-11-29T05:58:07,316   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-11-29T05:58:07,320   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-11-29T05:58:07,322   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-11-29T05:58:07,324   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-11-29T05:58:07,326   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-11-29T05:58:07,327   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-11-29T05:58:07,330   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-11-29T05:58:07,332   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-11-29T05:58:07,334   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-11-29T05:58:07,335   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-11-29T05:58:07,338   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2024-11-29T05:58:07,339   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2024-11-29T05:58:07,341   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2024-11-29T05:58:07,342   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2024-11-29T05:58:07,344   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2024-11-29T05:58:07,345   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2024-11-29T05:58:07,347   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-11-29T05:58:07,349   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-11-29T05:58:07,350   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-11-29T05:58:07,351   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-11-29T05:58:07,352   adding 'deepspeed/ops/csrc/includes/context.h'
2024-11-29T05:58:07,354   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-11-29T05:58:07,356   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-11-29T05:58:07,357   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-11-29T05:58:07,359   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-11-29T05:58:07,360   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-11-29T05:58:07,362   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-11-29T05:58:07,363   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-11-29T05:58:07,365   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-11-29T05:58:07,366   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-11-29T05:58:07,368   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-11-29T05:58:07,369   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-11-29T05:58:07,370   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-11-29T05:58:07,372   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-11-29T05:58:07,373   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-11-29T05:58:07,376   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-11-29T05:58:07,378   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-11-29T05:58:07,379   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-11-29T05:58:07,381   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-11-29T05:58:07,383   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-11-29T05:58:07,385   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-11-29T05:58:07,387   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-11-29T05:58:07,388   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-11-29T05:58:07,390   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-11-29T05:58:07,391   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-11-29T05:58:07,393   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-11-29T05:58:07,395   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-11-29T05:58:07,397   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-11-29T05:58:07,399   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-11-29T05:58:07,400   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-11-29T05:58:07,402   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-11-29T05:58:07,404   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-11-29T05:58:07,406   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-11-29T05:58:07,409   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-11-29T05:58:07,411   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-11-29T05:58:07,412   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-11-29T05:58:07,414   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-11-29T05:58:07,415   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-11-29T05:58:07,417   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-11-29T05:58:07,419   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-11-29T05:58:07,420   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-11-29T05:58:07,422   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-11-29T05:58:07,423   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-11-29T05:58:07,425   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-11-29T05:58:07,427   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-11-29T05:58:07,429   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-11-29T05:58:07,430   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-11-29T05:58:07,433   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-11-29T05:58:07,435   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-11-29T05:58:07,439   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-11-29T05:58:07,441   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-11-29T05:58:07,443   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-11-29T05:58:07,447   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-11-29T05:58:07,450   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-11-29T05:58:07,452   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-11-29T05:58:07,455   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-11-29T05:58:07,456   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-11-29T05:58:07,459   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-11-29T05:58:07,461   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-11-29T05:58:07,463   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-11-29T05:58:07,468   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-11-29T05:58:07,470   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-11-29T05:58:07,472   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-11-29T05:58:07,474   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-11-29T05:58:07,477   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-11-29T05:58:07,480   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-11-29T05:58:07,482   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-11-29T05:58:07,483   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-11-29T05:58:07,485   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-11-29T05:58:07,488   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-11-29T05:58:07,490   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-11-29T05:58:07,491   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-11-29T05:58:07,493   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-11-29T05:58:07,495   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-11-29T05:58:07,497   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-11-29T05:58:07,498   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-11-29T05:58:07,500   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-11-29T05:58:07,501   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-11-29T05:58:07,503   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-11-29T05:58:07,505   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-11-29T05:58:07,507   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-11-29T05:58:07,508   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-11-29T05:58:07,510   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-11-29T05:58:07,511   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-11-29T05:58:07,512   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-11-29T05:58:07,514   adding 'deepspeed/ops/gds/__init__.py'
2024-11-29T05:58:07,516   adding 'deepspeed/ops/lamb/__init__.py'
2024-11-29T05:58:07,517   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-11-29T05:58:07,519   adding 'deepspeed/ops/lion/__init__.py'
2024-11-29T05:58:07,520   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-11-29T05:58:07,522   adding 'deepspeed/ops/lion/fused_lion.py'
2024-11-29T05:58:07,523   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-11-29T05:58:07,526   adding 'deepspeed/ops/op_builder/__init__.py'
2024-11-29T05:58:07,527   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-11-29T05:58:07,528   adding 'deepspeed/ops/op_builder/async_io.py'
2024-11-29T05:58:07,533   adding 'deepspeed/ops/op_builder/builder.py'
2024-11-29T05:58:07,535   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-11-29T05:58:07,536   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-11-29T05:58:07,537   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-11-29T05:58:07,538   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-11-29T05:58:07,539   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-11-29T05:58:07,541   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-11-29T05:58:07,542   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-11-29T05:58:07,543   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-11-29T05:58:07,544   adding 'deepspeed/ops/op_builder/gds.py'
2024-11-29T05:58:07,546   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-11-29T05:58:07,547   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-11-29T05:58:07,548   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-11-29T05:58:07,550   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-11-29T05:58:07,552   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-11-29T05:58:07,553   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-11-29T05:58:07,554   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-11-29T05:58:07,555   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-11-29T05:58:07,557   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-11-29T05:58:07,558   adding 'deepspeed/ops/op_builder/transformer.py'
2024-11-29T05:58:07,559   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-11-29T05:58:07,561   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-11-29T05:58:07,563   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2024-11-29T05:58:07,564   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-11-29T05:58:07,565   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-11-29T05:58:07,566   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-11-29T05:58:07,567   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-11-29T05:58:07,569   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-11-29T05:58:07,570   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-11-29T05:58:07,572   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-11-29T05:58:07,573   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-11-29T05:58:07,574   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-11-29T05:58:07,575   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-11-29T05:58:07,577   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2024-11-29T05:58:07,578   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2024-11-29T05:58:07,580   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2024-11-29T05:58:07,581   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2024-11-29T05:58:07,582   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2024-11-29T05:58:07,583   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2024-11-29T05:58:07,584   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2024-11-29T05:58:07,586   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-11-29T05:58:07,588   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-11-29T05:58:07,589   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-11-29T05:58:07,590   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-11-29T05:58:07,591   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-11-29T05:58:07,592   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-11-29T05:58:07,594   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-11-29T05:58:07,596   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-11-29T05:58:07,597   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-11-29T05:58:07,599   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-11-29T05:58:07,600   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-11-29T05:58:07,602   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-11-29T05:58:07,603   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-11-29T05:58:07,604   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-11-29T05:58:07,606   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-11-29T05:58:07,607   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-11-29T05:58:07,608   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-11-29T05:58:07,609   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-11-29T05:58:07,610   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-11-29T05:58:07,612   adding 'deepspeed/ops/quantizer/__init__.py'
2024-11-29T05:58:07,613   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-11-29T05:58:07,615   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-11-29T05:58:07,616   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-11-29T05:58:07,618   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-11-29T05:58:07,620   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-11-29T05:58:07,623   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-11-29T05:58:07,626   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-11-29T05:58:07,628   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-11-29T05:58:07,629   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-11-29T05:58:07,633   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-11-29T05:58:07,635   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-11-29T05:58:07,636   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-11-29T05:58:07,638   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-11-29T05:58:07,640   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-11-29T05:58:07,642   adding 'deepspeed/ops/transformer/__init__.py'
2024-11-29T05:58:07,644   adding 'deepspeed/ops/transformer/transformer.py'
2024-11-29T05:58:07,646   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-11-29T05:58:07,647   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-11-29T05:58:07,649   adding 'deepspeed/ops/transformer/inference/config.py'
2024-11-29T05:58:07,650   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-11-29T05:58:07,652   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-11-29T05:58:07,654   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-11-29T05:58:07,656   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-11-29T05:58:07,658   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-11-29T05:58:07,660   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-11-29T05:58:07,662   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-11-29T05:58:07,664   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-11-29T05:58:07,665   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-11-29T05:58:07,667   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2024-11-29T05:58:07,668   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2024-11-29T05:58:07,669   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2024-11-29T05:58:07,670   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2024-11-29T05:58:07,671   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2024-11-29T05:58:07,672   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2024-11-29T05:58:07,674   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-11-29T05:58:07,675   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2024-11-29T05:58:07,676   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-11-29T05:58:07,678   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-11-29T05:58:07,679   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2024-11-29T05:58:07,681   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2024-11-29T05:58:07,682   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2024-11-29T05:58:07,684   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-11-29T05:58:07,685   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-11-29T05:58:07,686   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2024-11-29T05:58:07,688   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-11-29T05:58:07,689   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-11-29T05:58:07,690   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2024-11-29T05:58:07,692   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-11-29T05:58:07,693   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2024-11-29T05:58:07,695   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-11-29T05:58:07,697   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-11-29T05:58:07,699   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-11-29T05:58:07,700   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-11-29T05:58:07,703   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-11-29T05:58:07,704   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-11-29T05:58:07,706   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-11-29T05:58:07,707   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-11-29T05:58:07,708   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-11-29T05:58:07,710   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-11-29T05:58:07,712   adding 'deepspeed/pipe/__init__.py'
2024-11-29T05:58:07,713   adding 'deepspeed/profiling/__init__.py'
2024-11-29T05:58:07,715   adding 'deepspeed/profiling/config.py'
2024-11-29T05:58:07,716   adding 'deepspeed/profiling/constants.py'
2024-11-29T05:58:07,718   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-11-29T05:58:07,723   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-11-29T05:58:07,725   adding 'deepspeed/runtime/__init__.py'
2024-11-29T05:58:07,726   adding 'deepspeed/runtime/base_optimizer.py'
2024-11-29T05:58:07,729   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-11-29T05:58:07,731   adding 'deepspeed/runtime/compiler.py'
2024-11-29T05:58:07,735   adding 'deepspeed/runtime/config.py'
2024-11-29T05:58:07,738   adding 'deepspeed/runtime/config_utils.py'
2024-11-29T05:58:07,740   adding 'deepspeed/runtime/constants.py'
2024-11-29T05:58:07,742   adding 'deepspeed/runtime/dataloader.py'
2024-11-29T05:58:07,744   adding 'deepspeed/runtime/eigenvalue.py'
2024-11-29T05:58:07,762   adding 'deepspeed/runtime/engine.py'
2024-11-29T05:58:07,766   adding 'deepspeed/runtime/hybrid_engine.py'
2024-11-29T05:58:07,770   adding 'deepspeed/runtime/lr_schedules.py'
2024-11-29T05:58:07,771   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-11-29T05:58:07,773   adding 'deepspeed/runtime/quantize.py'
2024-11-29T05:58:07,779   adding 'deepspeed/runtime/sparse_tensor.py'
2024-11-29T05:58:07,781   adding 'deepspeed/runtime/state_dict_factory.py'
2024-11-29T05:58:07,786   adding 'deepspeed/runtime/utils.py'
2024-11-29T05:58:07,787   adding 'deepspeed/runtime/weight_quantizer.py'
2024-11-29T05:58:07,789   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-11-29T05:58:07,794   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-11-29T05:58:07,796   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-11-29T05:58:07,797   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-11-29T05:58:07,798   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-11-29T05:58:07,800   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-11-29T05:58:07,801   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-11-29T05:58:07,803   adding 'deepspeed/runtime/comm/__init__.py'
2024-11-29T05:58:07,804   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-11-29T05:58:07,806   adding 'deepspeed/runtime/comm/compressed.py'
2024-11-29T05:58:07,807   adding 'deepspeed/runtime/comm/hccl.py'
2024-11-29T05:58:07,809   adding 'deepspeed/runtime/comm/mpi.py'
2024-11-29T05:58:07,810   adding 'deepspeed/runtime/comm/nccl.py'
2024-11-29T05:58:07,812   adding 'deepspeed/runtime/compression/__init__.py'
2024-11-29T05:58:07,814   adding 'deepspeed/runtime/compression/cupy.py'
2024-11-29T05:58:07,815   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-11-29T05:58:07,816   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-11-29T05:58:07,818   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-11-29T05:58:07,819   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-11-29T05:58:07,821   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-11-29T05:58:07,823   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-11-29T05:58:07,824   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-11-29T05:58:07,826   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-11-29T05:58:07,827   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-11-29T05:58:07,829   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-11-29T05:58:07,835   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-11-29T05:58:07,837   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-11-29T05:58:07,840   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-11-29T05:58:07,842   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-11-29T05:58:07,843   adding 'deepspeed/runtime/domino/__init__.py'
2024-11-29T05:58:07,846   adding 'deepspeed/runtime/domino/transformer.py'
2024-11-29T05:58:07,847   adding 'deepspeed/runtime/fp16/__init__.py'
2024-11-29T05:58:07,850   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-11-29T05:58:07,852   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-11-29T05:58:07,855   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-11-29T05:58:07,857   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-11-29T05:58:07,859   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-11-29T05:58:07,861   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-11-29T05:58:07,864   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-11-29T05:58:07,866   adding 'deepspeed/runtime/pipe/__init__.py'
2024-11-29T05:58:07,874   adding 'deepspeed/runtime/pipe/engine.py'
2024-11-29T05:58:07,878   adding 'deepspeed/runtime/pipe/module.py'
2024-11-29T05:58:07,880   adding 'deepspeed/runtime/pipe/p2p.py'
2024-11-29T05:58:07,882   adding 'deepspeed/runtime/pipe/schedule.py'
2024-11-29T05:58:07,884   adding 'deepspeed/runtime/pipe/topology.py'
2024-11-29T05:58:07,886   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-11-29T05:58:07,887   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-11-29T05:58:07,889   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-11-29T05:58:07,890   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-11-29T05:58:07,892   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-11-29T05:58:07,894   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-11-29T05:58:07,897   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-11-29T05:58:07,898   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-11-29T05:58:07,900   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-11-29T05:58:07,902   adding 'deepspeed/runtime/zero/__init__.py'
2024-11-29T05:58:07,904   adding 'deepspeed/runtime/zero/config.py'
2024-11-29T05:58:07,906   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-11-29T05:58:07,908   adding 'deepspeed/runtime/zero/linear.py'
2024-11-29T05:58:07,911   adding 'deepspeed/runtime/zero/mics.py'
2024-11-29T05:58:07,913   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-11-29T05:58:07,914   adding 'deepspeed/runtime/zero/offload_config.py'
2024-11-29T05:58:07,916   adding 'deepspeed/runtime/zero/offload_states.py'
2024-11-29T05:58:07,919   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-11-29T05:58:07,931   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-11-29T05:58:07,935   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-11-29T05:58:07,936   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-11-29T05:58:07,952   adding 'deepspeed/runtime/zero/stage3.py'
2024-11-29T05:58:07,966   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-11-29T05:58:07,968   adding 'deepspeed/runtime/zero/test.py'
2024-11-29T05:58:07,970   adding 'deepspeed/runtime/zero/tiling.py'
2024-11-29T05:58:07,972   adding 'deepspeed/runtime/zero/utils.py'
2024-11-29T05:58:07,974   adding 'deepspeed/sequence/__init__.py'
2024-11-29T05:58:07,975   adding 'deepspeed/sequence/cross_entropy.py'
2024-11-29T05:58:07,977   adding 'deepspeed/sequence/layer.py'
2024-11-29T05:58:07,980   adding 'deepspeed/utils/__init__.py'
2024-11-29T05:58:07,981   adding 'deepspeed/utils/bwc.py'
2024-11-29T05:58:07,983   adding 'deepspeed/utils/comms_logging.py'
2024-11-29T05:58:07,984   adding 'deepspeed/utils/config.py'
2024-11-29T05:58:07,985   adding 'deepspeed/utils/debug.py'
2024-11-29T05:58:07,986   adding 'deepspeed/utils/exceptions.py'
2024-11-29T05:58:07,989   adding 'deepspeed/utils/groups.py'
2024-11-29T05:58:07,991   adding 'deepspeed/utils/init_on_device.py'
2024-11-29T05:58:07,992   adding 'deepspeed/utils/logging.py'
2024-11-29T05:58:07,994   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-11-29T05:58:07,996   adding 'deepspeed/utils/numa.py'
2024-11-29T05:58:07,997   adding 'deepspeed/utils/nvtx.py'
2024-11-29T05:58:07,999   adding 'deepspeed/utils/tensor_fragment.py'
2024-11-29T05:58:08,001   adding 'deepspeed/utils/timer.py'
2024-11-29T05:58:08,002   adding 'deepspeed/utils/torch.py'
2024-11-29T05:58:08,004   adding 'deepspeed/utils/types.py'
2024-11-29T05:58:08,005   adding 'deepspeed/utils/z3_leaf_module.py'
2024-11-29T05:58:08,009   adding 'deepspeed/utils/zero_to_fp32.py'
2024-11-29T05:58:08,011   adding 'deepspeed-0.16.0.data/scripts/deepspeed'
2024-11-29T05:58:08,012   adding 'deepspeed-0.16.0.data/scripts/deepspeed.pt'
2024-11-29T05:58:08,014   adding 'deepspeed-0.16.0.data/scripts/ds'
2024-11-29T05:58:08,015   adding 'deepspeed-0.16.0.data/scripts/ds_bench'
2024-11-29T05:58:08,016   adding 'deepspeed-0.16.0.data/scripts/ds_elastic'
2024-11-29T05:58:08,017   adding 'deepspeed-0.16.0.data/scripts/ds_io'
2024-11-29T05:58:08,019   adding 'deepspeed-0.16.0.data/scripts/ds_nvme_tune'
2024-11-29T05:58:08,020   adding 'deepspeed-0.16.0.data/scripts/ds_report'
2024-11-29T05:58:08,021   adding 'deepspeed-0.16.0.data/scripts/ds_ssh'
2024-11-29T05:58:08,022   adding 'deepspeed-0.16.0.data/scripts/dsr'
2024-11-29T05:58:08,025   adding 'deepspeed-0.16.0.dist-info/LICENSE'
2024-11-29T05:58:08,030   adding 'deepspeed-0.16.0.dist-info/METADATA'
2024-11-29T05:58:08,031   adding 'deepspeed-0.16.0.dist-info/WHEEL'
2024-11-29T05:58:08,032   adding 'deepspeed-0.16.0.dist-info/entry_points.txt'
2024-11-29T05:58:08,033   adding 'deepspeed-0.16.0.dist-info/top_level.txt'
2024-11-29T05:58:08,047   adding 'deepspeed-0.16.0.dist-info/RECORD'
2024-11-29T05:58:08,073   removing build/bdist.linux-armv7l/wheel
2024-11-29T05:58:08,302   deepspeed build time = 12.345176219940186 secs
2024-11-29T05:58:08,424   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-11-29T05:58:08,442   Created wheel for deepspeed: filename=deepspeed-0.16.0-py3-none-any.whl size=1535069 sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4
2024-11-29T05:58:08,443   Stored in directory: /tmp/pip-ephem-wheel-cache-ro9chzv8/wheels/b5/7b/e4/877d24ca8f6c0bfe5956412b8174089d8f5b0e06c21bf1bcee
2024-11-29T05:58:08,495 Successfully built deepspeed
2024-11-29T05:58:08,547 Removed build tracker: '/tmp/pip-build-tracker-i5n9x_rw'