2024-04-24T00:52:44,784 Created temporary directory: /tmp/pip-build-tracker-5yu7dyo6
2024-04-24T00:52:44,787 Initialized build tracking at /tmp/pip-build-tracker-5yu7dyo6
2024-04-24T00:52:44,788 Created build tracker: /tmp/pip-build-tracker-5yu7dyo6
2024-04-24T00:52:44,788 Entered build tracker: /tmp/pip-build-tracker-5yu7dyo6
2024-04-24T00:52:44,789 Created temporary directory: /tmp/pip-wheel-507n3inj
2024-04-24T00:52:44,800 Created temporary directory: /tmp/pip-ephem-wheel-cache-fa49k7yx
2024-04-24T00:52:44,855 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-04-24T00:52:44,869 2 location(s) to search for versions of deepspeed:
2024-04-24T00:52:44,869 * https://pypi.org/simple/deepspeed/
2024-04-24T00:52:44,869 * https://www.piwheels.org/simple/deepspeed/
2024-04-24T00:52:44,870 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-04-24T00:52:44,871 Getting page https://pypi.org/simple/deepspeed/
2024-04-24T00:52:44,874 Found index url https://pypi.org/simple/
2024-04-24T00:52:44,990 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-04-24T00:52:45,036   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-04-24T00:52:45,037   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-04-24T00:52:45,038   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-04-24T00:52:45,038   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-04-24T00:52:45,039   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-04-24T00:52:45,039   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-04-24T00:52:45,040   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-04-24T00:52:45,041   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-04-24T00:52:45,041   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-04-24T00:52:45,042   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-04-24T00:52:45,043   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-04-24T00:52:45,043   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-04-24T00:52:45,044   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-04-24T00:52:45,045   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-04-24T00:52:45,045   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-04-24T00:52:45,046   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-04-24T00:52:45,047   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-04-24T00:52:45,047   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-04-24T00:52:45,048   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-04-24T00:52:45,049   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-04-24T00:52:45,049   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-04-24T00:52:45,050   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-04-24T00:52:45,051   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-04-24T00:52:45,051   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-04-24T00:52:45,052   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-04-24T00:52:45,053   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-04-24T00:52:45,053   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-04-24T00:52:45,054   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-04-24T00:52:45,055   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-04-24T00:52:45,055   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-04-24T00:52:45,056   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-04-24T00:52:45,057   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-04-24T00:52:45,057   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-04-24T00:52:45,058   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-04-24T00:52:45,059   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-04-24T00:52:45,059   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-04-24T00:52:45,060   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-04-24T00:52:45,061   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-04-24T00:52:45,061   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-04-24T00:52:45,062   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-04-24T00:52:45,063   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-04-24T00:52:45,063   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-04-24T00:52:45,064   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-04-24T00:52:45,065   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-04-24T00:52:45,065   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-04-24T00:52:45,066   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-04-24T00:52:45,067   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-04-24T00:52:45,067   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-04-24T00:52:45,068   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-04-24T00:52:45,069   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-04-24T00:52:45,069   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-04-24T00:52:45,070   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-04-24T00:52:45,071   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-04-24T00:52:45,071   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-04-24T00:52:45,072   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-04-24T00:52:45,073   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-04-24T00:52:45,073   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-04-24T00:52:45,074   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-04-24T00:52:45,074   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-04-24T00:52:45,075   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-04-24T00:52:45,076   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-04-24T00:52:45,077   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-04-24T00:52:45,077   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-04-24T00:52:45,078   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-04-24T00:52:45,078   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-04-24T00:52:45,079   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-04-24T00:52:45,080   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-04-24T00:52:45,080   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-04-24T00:52:45,081   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-04-24T00:52:45,082   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-04-24T00:52:45,082   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-04-24T00:52:45,083   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-04-24T00:52:45,084   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-04-24T00:52:45,084   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-04-24T00:52:45,085   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-04-24T00:52:45,086   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-04-24T00:52:45,086   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-04-24T00:52:45,087   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-04-24T00:52:45,088   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-04-24T00:52:45,088   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-04-24T00:52:45,089   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-04-24T00:52:45,090   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-04-24T00:52:45,090   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-04-24T00:52:45,091   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-04-24T00:52:45,092   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-04-24T00:52:45,092   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-04-24T00:52:45,093   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-04-24T00:52:45,094   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-04-24T00:52:45,094   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-04-24T00:52:45,095   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-04-24T00:52:45,096   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-04-24T00:52:45,096   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-04-24T00:52:45,097   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-04-24T00:52:45,098   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-04-24T00:52:45,099 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-04-24T00:52:45,099 Getting page https://www.piwheels.org/simple/deepspeed/
2024-04-24T00:52:45,102 Found index url https://www.piwheels.org/simple/
2024-04-24T00:52:45,319 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-04-24T00:52:45,364   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,364   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,365   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,365   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,366   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,366   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,367   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,368   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,368   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,369   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,369   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,370   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,370   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,370   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,371   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,371   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,372   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,372   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,373   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,373   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,374   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,374   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,375   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,375   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,376   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,376   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,377   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,377   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,378   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,378   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,379   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,379   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,380   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,380   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,381   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,381   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,382   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,382   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,383   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,383   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,384   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,384   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,385   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,385   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,386   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,386   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,387   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,387   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,388   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,388   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,389   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,389   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,390   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,390   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,391   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,391   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,392   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,392   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,393   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,393   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,394   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,394   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,395   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-04-24T00:52:45,395 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-04-24T00:52:45,396 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-04-24T00:52:45,461 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-04-24T00:52:45,494 Collecting deepspeed==0.14.2
2024-04-24T00:52:45,498   Created temporary directory: /tmp/pip-unpack-i_h328t7
2024-04-24T00:52:45,595   Downloading deepspeed-0.14.2.tar.gz (1.3 MB)
2024-04-24T00:52:50,820   Added deepspeed==0.14.2 from https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz to build tracker '/tmp/pip-build-tracker-5yu7dyo6'
2024-04-24T00:52:50,824   Running setup.py (path:/tmp/pip-wheel-507n3inj/deepspeed_5bd60b3d05394640bb214c0658be1f6c/setup.py) egg_info for package deepspeed
2024-04-24T00:52:50,826   Created temporary directory: /tmp/pip-pip-egg-info-1jze_fdq
2024-04-24T00:52:50,826   Preparing metadata (setup.py): started
2024-04-24T00:52:50,828   Running command python setup.py egg_info
2024-04-24T00:52:53,272   fatal: not a git repository (or any of the parent directories): .git
2024-04-24T00:52:55,111   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-04-24T00:52:55,112    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-04-24T00:52:55,112   DS_BUILD_OPS=0
2024-04-24T00:52:55,112    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-04-24T00:52:55,113    [WARNING]  async_io: please install the libaio-dev package with apt
2024-04-24T00:52:55,113    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-04-24T00:52:55,113    [WARNING]  Please install torch if trying to pre-compile kernels
2024-04-24T00:52:55,114    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:52:55,114    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:52:55,114    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:52:55,115    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:52:55,115    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:52:55,115    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:52:55,116    [WARNING]  unable to import torch, please install it first
2024-04-24T00:52:55,116    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:52:55,117   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-04-24T00:52:55,117   version=0.14.2, git_hash=unknown, git_branch=unknown
2024-04-24T00:52:55,117   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-04-24T00:52:55,118   ext_modules=[]
2024-04-24T00:52:55,118   running egg_info
2024-04-24T00:52:55,118   creating /tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info
2024-04-24T00:52:55,173   writing /tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info/PKG-INFO
2024-04-24T00:52:55,181   writing dependency_links to /tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info/dependency_links.txt
2024-04-24T00:52:55,184   writing entry points to /tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info/entry_points.txt
2024-04-24T00:52:55,189   writing requirements to /tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info/requires.txt
2024-04-24T00:52:55,192   writing top-level names to /tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info/top_level.txt
2024-04-24T00:52:55,195   writing manifest file '/tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info/SOURCES.txt'
2024-04-24T00:52:55,625   reading manifest file '/tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info/SOURCES.txt'
2024-04-24T00:52:55,629   reading manifest template 'MANIFEST.in'
2024-04-24T00:52:55,633   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-04-24T00:52:55,634   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-04-24T00:52:58,460   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-04-24T00:53:00,521   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-04-24T00:53:01,773   warning: no files found matching '*.tr' under directory 'csrc'
2024-04-24T00:53:02,046   warning: no files found matching '*.cc' under directory 'csrc'
2024-04-24T00:53:02,131   warning: no files found matching '*.py' under directory 'benchmarks'
2024-04-24T00:53:02,251   writing manifest file '/tmp/pip-pip-egg-info-1jze_fdq/deepspeed.egg-info/SOURCES.txt'
2024-04-24T00:53:02,256   deepspeed build time = 8.972906112670898 secs
2024-04-24T00:53:02,436   Preparing metadata (setup.py): finished with status 'done'
2024-04-24T00:53:02,456   Source in /tmp/pip-wheel-507n3inj/deepspeed_5bd60b3d05394640bb214c0658be1f6c has version 0.14.2, which satisfies requirement deepspeed==0.14.2 from https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz
2024-04-24T00:53:02,458   Removed deepspeed==0.14.2 from https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz from build tracker '/tmp/pip-build-tracker-5yu7dyo6'
2024-04-24T00:53:02,476 Created temporary directory: /tmp/pip-unpack-r3it10f1
2024-04-24T00:53:02,478 Created temporary directory: /tmp/pip-unpack-qhvs2l5g
2024-04-24T00:53:02,736 Building wheels for collected packages: deepspeed
2024-04-24T00:53:02,744   Created temporary directory: /tmp/pip-wheel-f3s017r0
2024-04-24T00:53:02,745   Building wheel for deepspeed (setup.py): started
2024-04-24T00:53:02,747   Destination directory: /tmp/pip-wheel-f3s017r0
2024-04-24T00:53:02,747   Running command python setup.py bdist_wheel
2024-04-24T00:53:03,878   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-04-24T00:53:03,903    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-04-24T00:53:04,105   DS_BUILD_OPS=0
2024-04-24T00:53:04,405    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-04-24T00:53:04,554    [WARNING]  async_io: please install the libaio-dev package with apt
2024-04-24T00:53:04,555    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-04-24T00:53:04,558    [WARNING]  Please install torch if trying to pre-compile kernels
2024-04-24T00:53:04,559    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:53:04,561    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:53:04,562    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:53:04,563    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:53:04,564    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:53:04,565    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:53:04,567    [WARNING]  unable to import torch, please install it first
2024-04-24T00:53:04,568    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-04-24T00:53:04,568   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-04-24T00:53:04,608   fatal: not a git repository (or any of the parent directories): .git
2024-04-24T00:53:04,614   version=0.14.2, git_hash=unknown, git_branch=unknown
2024-04-24T00:53:04,616   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-04-24T00:53:04,616   ext_modules=[]
2024-04-24T00:53:06,299   running bdist_wheel
2024-04-24T00:53:06,471   running build
2024-04-24T00:53:06,472   running build_py
2024-04-24T00:53:06,538   creating build
2024-04-24T00:53:06,540   creating build/lib
2024-04-24T00:53:06,542   creating build/lib/deepspeed
2024-04-24T00:53:06,545   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-04-24T00:53:06,551   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-04-24T00:53:06,555   copying deepspeed/constants.py -> build/lib/deepspeed
2024-04-24T00:53:06,559   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-04-24T00:53:06,564   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-04-24T00:53:06,568   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-04-24T00:53:06,573   creating build/lib/deepspeed/sequence
2024-04-24T00:53:06,575   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-04-24T00:53:06,580   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-04-24T00:53:06,586   creating build/lib/deepspeed/launcher
2024-04-24T00:53:06,588   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-04-24T00:53:06,594   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-04-24T00:53:06,599   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-04-24T00:53:06,603   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-04-24T00:53:06,608   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-04-24T00:53:06,613   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-04-24T00:53:06,620   creating build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,623   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,628   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,632   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,636   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,641   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,646   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,650   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,653   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,658   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,663   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-04-24T00:53:06,669   creating build/lib/deepspeed/moe
2024-04-24T00:53:06,671   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-04-24T00:53:06,677   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-04-24T00:53:06,680   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-04-24T00:53:06,684   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-04-24T00:53:06,689   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-04-24T00:53:06,693   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-04-24T00:53:06,698   creating build/lib/deepspeed/ops
2024-04-24T00:53:06,700   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-04-24T00:53:06,707   creating build/lib/deepspeed/runtime
2024-04-24T00:53:06,709   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,713   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,717   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,721   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,726   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,729   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,733   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,739   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,745   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,751   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,755   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,760   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,764   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,769   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,772   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,778   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,784   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,797   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-04-24T00:53:06,803   creating build/lib/deepspeed/comm
2024-04-24T00:53:06,805   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,808   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,812   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,815   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,820   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,825   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,828   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,832   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,836   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-04-24T00:53:06,841   creating build/lib/deepspeed/linear
2024-04-24T00:53:06,842   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-04-24T00:53:06,846   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-04-24T00:53:06,850   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-04-24T00:53:06,854   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-04-24T00:53:06,859   creating build/lib/deepspeed/accelerator
2024-04-24T00:53:06,861   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,865   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,870   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,874   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,878   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,882   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,886   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,891   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,895   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-04-24T00:53:06,901   creating build/lib/deepspeed/monitor
2024-04-24T00:53:06,903   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-04-24T00:53:06,907   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-04-24T00:53:06,910   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-04-24T00:53:06,914   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-04-24T00:53:06,917   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-04-24T00:53:06,921   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-04-24T00:53:06,925   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-04-24T00:53:06,930   creating build/lib/deepspeed/compression
2024-04-24T00:53:06,932   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-04-24T00:53:06,939   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-04-24T00:53:06,943   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-04-24T00:53:06,947   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-04-24T00:53:06,951   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-04-24T00:53:06,955   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-04-24T00:53:06,962   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-04-24T00:53:06,967   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-04-24T00:53:06,975   creating build/lib/deepspeed/module_inject
2024-04-24T00:53:06,977   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:06,982   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:06,987   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:06,991   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:06,995   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,000   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,004   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,009   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,013   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,020   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,024   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,031   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,036   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-04-24T00:53:07,041   creating build/lib/deepspeed/model_implementations
2024-04-24T00:53:07,043   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-04-24T00:53:07,049   creating build/lib/deepspeed/elasticity
2024-04-24T00:53:07,051   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-04-24T00:53:07,055   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-04-24T00:53:07,059   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-04-24T00:53:07,064   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-04-24T00:53:07,069   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-04-24T00:53:07,075   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-04-24T00:53:07,080   creating build/lib/deepspeed/inference
2024-04-24T00:53:07,082   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-04-24T00:53:07,086   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-04-24T00:53:07,090   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-04-24T00:53:07,097   creating build/lib/deepspeed/profiling
2024-04-24T00:53:07,099   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-04-24T00:53:07,102   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-04-24T00:53:07,106   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-04-24T00:53:07,112   creating build/lib/deepspeed/nebula
2024-04-24T00:53:07,114   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-04-24T00:53:07,119   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-04-24T00:53:07,123   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-04-24T00:53:07,128   creating build/lib/deepspeed/autotuning
2024-04-24T00:53:07,130   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-04-24T00:53:07,134   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-04-24T00:53:07,138   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-04-24T00:53:07,142   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-04-24T00:53:07,147   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-04-24T00:53:07,154   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-04-24T00:53:07,160   creating build/lib/deepspeed/utils
2024-04-24T00:53:07,162   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,167   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,170   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,173   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,178   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,182   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,186   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,190   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,194   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,198   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,203   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,208   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,212   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,216   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,221   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,225   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,230   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-04-24T00:53:07,235   creating build/lib/deepspeed/pipe
2024-04-24T00:53:07,238   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-04-24T00:53:07,243   creating build/lib/deepspeed/ops/quantizer
2024-04-24T00:53:07,246   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-04-24T00:53:07,250   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-04-24T00:53:07,256   creating build/lib/deepspeed/ops/random_ltd
2024-04-24T00:53:07,258   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-04-24T00:53:07,262   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-04-24T00:53:07,268   creating build/lib/deepspeed/ops/lamb
2024-04-24T00:53:07,271   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-04-24T00:53:07,275   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-04-24T00:53:07,282   creating build/lib/deepspeed/ops/adam
2024-04-24T00:53:07,285   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-04-24T00:53:07,289   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-04-24T00:53:07,294   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-04-24T00:53:07,299   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-04-24T00:53:07,305   creating build/lib/deepspeed/ops/adagrad
2024-04-24T00:53:07,308   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-04-24T00:53:07,312   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-04-24T00:53:07,320   creating build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,323   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,328   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,332   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,339   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,343   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,347   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,351   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,356   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,360   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,364   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,368   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,373   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,378   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,382   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,386   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,390   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,394   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,398   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,401   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,405   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,409   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,412   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,415   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-04-24T00:53:07,420   creating build/lib/deepspeed/ops/fp_quantizer
2024-04-24T00:53:07,422   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-04-24T00:53:07,426   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-04-24T00:53:07,431   creating build/lib/deepspeed/ops/lion
2024-04-24T00:53:07,433   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-04-24T00:53:07,437   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-04-24T00:53:07,441   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-04-24T00:53:07,445   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-04-24T00:53:07,450   creating build/lib/deepspeed/ops/deepspeed4science
2024-04-24T00:53:07,452   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-04-24T00:53:07,456   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-04-24T00:53:07,461   creating build/lib/deepspeed/ops/aio
2024-04-24T00:53:07,462   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-04-24T00:53:07,468   creating build/lib/deepspeed/ops/sparse_attention
2024-04-24T00:53:07,470   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-04-24T00:53:07,474   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-04-24T00:53:07,478   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-04-24T00:53:07,481   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-04-24T00:53:07,486   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-04-24T00:53:07,492   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-04-24T00:53:07,498   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-04-24T00:53:07,504   creating build/lib/deepspeed/ops/transformer
2024-04-24T00:53:07,505   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-04-24T00:53:07,511   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-04-24T00:53:07,516   creating build/lib/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:07,518   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:07,523   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:07,526   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:07,530   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:07,534   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:07,537   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:07,542   creating build/lib/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:07,544   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:07,548   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:07,551   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:07,555   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:07,559   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:07,562   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:07,567   creating build/lib/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:07,570   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:07,573   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:07,577   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:07,581   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:07,584   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:07,590   creating build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,592   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,596   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,600   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,605   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,608   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,612   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,615   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,619   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,623   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-04-24T00:53:07,628   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:07,629   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:07,636   creating build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,637   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,641   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,644   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,650   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,655   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,660   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,664   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,668   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,673   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,678   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-04-24T00:53:07,685   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,687   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,691   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,695   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,699   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,703   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,707   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,713   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,717   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,722   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,727   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:07,734   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,736   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,740   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,747   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,751   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,754   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,758   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,762   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,765   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,769   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,773   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:07,779   creating build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,781   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,786   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,791   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,794   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,797   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,802   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,805   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,809   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,814   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-04-24T00:53:07,821   creating build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,823   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,829   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,839   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,844   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,848   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,858   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,862   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,866   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,869   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,874   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,878   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,882   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,889   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,895   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,900   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,905   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-04-24T00:53:07,925   creating build/lib/deepspeed/runtime/comm
2024-04-24T00:53:07,927   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-04-24T00:53:07,931   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-04-24T00:53:07,934   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-04-24T00:53:07,939   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-04-24T00:53:07,944   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-04-24T00:53:07,951   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-04-24T00:53:07,953   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-04-24T00:53:07,957   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-04-24T00:53:07,965   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-04-24T00:53:07,970   creating build/lib/deepspeed/runtime/compression
2024-04-24T00:53:07,971   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-04-24T00:53:07,975   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-04-24T00:53:07,980   creating build/lib/deepspeed/runtime/fp16
2024-04-24T00:53:07,982   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-04-24T00:53:07,986   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-04-24T00:53:07,991   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-04-24T00:53:07,996   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-04-24T00:53:08,003   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:08,005   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:08,009   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:08,013   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:08,017   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:08,022   creating build/lib/deepspeed/runtime/pipe
2024-04-24T00:53:08,024   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-04-24T00:53:08,029   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-04-24T00:53:08,035   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-04-24T00:53:08,039   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-04-24T00:53:08,044   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-04-24T00:53:08,052   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-04-24T00:53:08,059   creating build/lib/deepspeed/runtime/data_pipeline
2024-04-24T00:53:08,061   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-04-24T00:53:08,066   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-04-24T00:53:08,070   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-04-24T00:53:08,075   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-04-24T00:53:08,082   creating build/lib/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:08,084   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:08,090   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:08,096   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:08,100   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:08,107   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:08,110   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:08,115   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:08,119   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:08,123   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:08,128   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:08,134   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:08,136   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:08,144   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:08,149   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:08,153   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:08,159   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:08,166   creating build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,169   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,173   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,178   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,183   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,188   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,192   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,196   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,200   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,205   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,210   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,214   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,219   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,224   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,228   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,232   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,237   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,241   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,245   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,250   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-04-24T00:53:08,256   creating build/lib/deepspeed/module_inject/containers/features
2024-04-24T00:53:08,258   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-04-24T00:53:08,263   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-04-24T00:53:08,268   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-04-24T00:53:08,273   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-04-24T00:53:08,278   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-04-24T00:53:08,281   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-04-24T00:53:08,285   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-04-24T00:53:08,291   creating build/lib/deepspeed/model_implementations/features
2024-04-24T00:53:08,292   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-04-24T00:53:08,296   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-04-24T00:53:08,302   creating build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,304   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,308   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,312   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,316   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,319   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,323   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,326   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,330   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,333   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,336   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-04-24T00:53:08,341   creating build/lib/deepspeed/model_implementations/diffusers
2024-04-24T00:53:08,343   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-04-24T00:53:08,347   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-04-24T00:53:08,351   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-04-24T00:53:08,356   creating build/lib/deepspeed/inference/quantization
2024-04-24T00:53:08,358   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-04-24T00:53:08,362   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-04-24T00:53:08,365   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-04-24T00:53:08,370   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-04-24T00:53:08,374   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-04-24T00:53:08,380   creating build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,382   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,386   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,389   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,393   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,396   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,401   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,405   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,409   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,412   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-04-24T00:53:08,417   creating build/lib/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:08,419   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:08,423   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:08,426   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:08,430   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:08,436   creating build/lib/deepspeed/inference/v2/ragged
2024-04-24T00:53:08,438   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-04-24T00:53:08,442   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-04-24T00:53:08,445   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-04-24T00:53:08,450   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-04-24T00:53:08,454   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-04-24T00:53:08,458   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-04-24T00:53:08,463   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-04-24T00:53:08,470   creating build/lib/deepspeed/inference/v2/kernels
2024-04-24T00:53:08,471   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-04-24T00:53:08,475   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-04-24T00:53:08,480   creating build/lib/deepspeed/inference/v2/modules
2024-04-24T00:53:08,481   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-04-24T00:53:08,485   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-04-24T00:53:08,489   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-04-24T00:53:08,493   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-04-24T00:53:08,498   creating build/lib/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:08,500   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:08,505   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:08,510   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:08,513   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:08,518   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:08,523   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:08,528   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:08,534   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-04-24T00:53:08,536   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-04-24T00:53:08,542   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-04-24T00:53:08,543   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-04-24T00:53:08,549   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-04-24T00:53:08,550   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-04-24T00:53:08,555   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:08,557   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:08,562   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:08,567   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:08,569   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:08,572   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:08,578   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:08,580   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:08,584   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:08,589   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:08,591   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:08,595   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:08,599   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:08,603   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:08,609   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:08,610   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:08,614   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:08,619   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:08,621   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:08,625   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:08,630   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:08,632   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:08,636   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:08,641   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:08,643   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:08,647   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:08,652   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:08,655   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:08,659   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:08,663   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:08,667   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:08,670   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:08,676   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:08,677   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:08,681   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:08,685   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:08,689   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:08,694   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:08,695   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:08,700   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:08,705   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:08,707   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:08,710   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:08,715   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:08,717   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:08,721   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:08,727   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:08,729   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:08,733   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:08,738   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:08,739   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:08,744   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:08,748   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:08,753   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:08,755   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:08,759   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:08,764   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-04-24T00:53:08,766   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-04-24T00:53:08,772   creating build/lib/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:08,773   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:08,777   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:08,781   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:08,785   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:08,789   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:08,792   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:08,796   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:08,802   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,804   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,809   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,812   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,816   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,820   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,824   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,828   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,831   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:08,836   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-04-24T00:53:08,838   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-04-24T00:53:08,842   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-04-24T00:53:08,848   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-04-24T00:53:08,850   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-04-24T00:53:08,854   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-04-24T00:53:08,859   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-04-24T00:53:08,861   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-04-24T00:53:08,864   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-04-24T00:53:08,869   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-04-24T00:53:08,871   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-04-24T00:53:08,875   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-04-24T00:53:08,879   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-04-24T00:53:08,885   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-04-24T00:53:08,888   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-04-24T00:53:08,892   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-04-24T00:53:08,898   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-04-24T00:53:08,900   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-04-24T00:53:08,905   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-04-24T00:53:08,911   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-04-24T00:53:08,913   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-04-24T00:53:08,918   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-04-24T00:53:08,922   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-04-24T00:53:08,928   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:08,930   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:08,935   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:08,939   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:08,944   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:08,949   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:08,951   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:08,955   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:08,959   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:08,963   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:08,968   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:08,970   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:08,974   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:08,978   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:08,982   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:08,988   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:08,990   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:08,994   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:08,998   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:09,001   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:09,005   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:09,009   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:09,012   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:09,016   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:09,020   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:09,025   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,027   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,031   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,035   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,039   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,043   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,047   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,051   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,055   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,059   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:09,064   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:09,066   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:09,069   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:09,073   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:09,078   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:09,083   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:09,084   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:09,088   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:09,092   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:09,096   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:09,101   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:09,103   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:09,107   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:09,111   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:09,115   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:09,120   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:09,122   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:09,126   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:09,129   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:09,134   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:09,139   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:09,141   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:09,144   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:09,148   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:09,153   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:09,158   creating build/lib/deepspeed/profiling/flops_profiler
2024-04-24T00:53:09,159   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-04-24T00:53:09,163   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-04-24T00:53:09,171   creating build/lib/deepspeed/autotuning/tuner
2024-04-24T00:53:09,173   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-04-24T00:53:09,177   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-04-24T00:53:09,180   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-04-24T00:53:09,184   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-04-24T00:53:09,188   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-04-24T00:53:09,192   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-04-24T00:53:09,199   running egg_info
2024-04-24T00:53:09,314   writing deepspeed.egg-info/PKG-INFO
2024-04-24T00:53:09,321   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-04-24T00:53:09,325   writing entry points to deepspeed.egg-info/entry_points.txt
2024-04-24T00:53:09,329   writing requirements to deepspeed.egg-info/requires.txt
2024-04-24T00:53:09,332   writing top-level names to deepspeed.egg-info/top_level.txt
2024-04-24T00:53:09,564   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-04-24T00:53:09,741   reading manifest template 'MANIFEST.in'
2024-04-24T00:53:09,745   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-04-24T00:53:09,745   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-04-24T00:53:12,537   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-04-24T00:53:14,597   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-04-24T00:53:16,046   warning: no files found matching '*.tr' under directory 'csrc'
2024-04-24T00:53:16,313   warning: no files found matching '*.cc' under directory 'csrc'
2024-04-24T00:53:16,395   warning: no files found matching '*.py' under directory 'benchmarks'
2024-04-24T00:53:16,550   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-04-24T00:53:16,575   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-04-24T00:53:16,576   !!

2024-04-24T00:53:16,577           ********************************************************************************
2024-04-24T00:53:16,577           ############################
2024-04-24T00:53:16,577           # Package would be ignored #
2024-04-24T00:53:16,577           ############################
2024-04-24T00:53:16,578           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-04-24T00:53:16,578           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,579           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,579           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-04-24T00:53:16,579           to the `packages` configuration field.

2024-04-24T00:53:16,580           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,580           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,580           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,581           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,582           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,582           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-04-24T00:53:16,582           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-04-24T00:53:16,583           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,583           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,583           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,584           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,584           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,585           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,585                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,586                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,586                 directory, all directories are treated like packages.
2024-04-24T00:53:16,586           ********************************************************************************

2024-04-24T00:53:16,587   !!
2024-04-24T00:53:16,587     check.warn(importable)
2024-04-24T00:53:16,588   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-04-24T00:53:16,588   !!

2024-04-24T00:53:16,589           ********************************************************************************
2024-04-24T00:53:16,589           ############################
2024-04-24T00:53:16,589           # Package would be ignored #
2024-04-24T00:53:16,590           ############################
2024-04-24T00:53:16,590           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-04-24T00:53:16,590           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,591           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,591           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-04-24T00:53:16,591           to the `packages` configuration field.

2024-04-24T00:53:16,592           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,592           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,592           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,593           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,594           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,594           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-04-24T00:53:16,594           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-04-24T00:53:16,595           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,595           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,595           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,596           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,596           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,597           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,598                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,598                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,598                 directory, all directories are treated like packages.
2024-04-24T00:53:16,598           ********************************************************************************

2024-04-24T00:53:16,599   !!
2024-04-24T00:53:16,599     check.warn(importable)
2024-04-24T00:53:16,599   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-04-24T00:53:16,600   !!

2024-04-24T00:53:16,600           ********************************************************************************
2024-04-24T00:53:16,601           ############################
2024-04-24T00:53:16,601           # Package would be ignored #
2024-04-24T00:53:16,601           ############################
2024-04-24T00:53:16,601           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-04-24T00:53:16,602           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,602           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,603           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-04-24T00:53:16,603           to the `packages` configuration field.

2024-04-24T00:53:16,603           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,604           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,604           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,604           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,605           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,606           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-04-24T00:53:16,606           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-04-24T00:53:16,606           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,607           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,607           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,608           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,608           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,609           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,609                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,610                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,610                 directory, all directories are treated like packages.
2024-04-24T00:53:16,610           ********************************************************************************

2024-04-24T00:53:16,611   !!
2024-04-24T00:53:16,611     check.warn(importable)
2024-04-24T00:53:16,611   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-04-24T00:53:16,611   !!

2024-04-24T00:53:16,612           ********************************************************************************
2024-04-24T00:53:16,612           ############################
2024-04-24T00:53:16,613           # Package would be ignored #
2024-04-24T00:53:16,613           ############################
2024-04-24T00:53:16,613           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-04-24T00:53:16,613           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,614           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,614           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-04-24T00:53:16,615           to the `packages` configuration field.

2024-04-24T00:53:16,615           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,615           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,616           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,616           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,617           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,617           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-04-24T00:53:16,618           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-04-24T00:53:16,618           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,618           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,619           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,619           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,620           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,621           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,621                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,621                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,621                 directory, all directories are treated like packages.
2024-04-24T00:53:16,622           ********************************************************************************

2024-04-24T00:53:16,622   !!
2024-04-24T00:53:16,623     check.warn(importable)
2024-04-24T00:53:16,623   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-04-24T00:53:16,623   !!

2024-04-24T00:53:16,624           ********************************************************************************
2024-04-24T00:53:16,624           ############################
2024-04-24T00:53:16,625           # Package would be ignored #
2024-04-24T00:53:16,625           ############################
2024-04-24T00:53:16,625           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-04-24T00:53:16,626           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,626           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,627           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-04-24T00:53:16,627           to the `packages` configuration field.

2024-04-24T00:53:16,627           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,628           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,628           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,629           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,629           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,630           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-04-24T00:53:16,630           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-04-24T00:53:16,630           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,631           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,631           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,631           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,632           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,633           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,633                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,633                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,634                 directory, all directories are treated like packages.
2024-04-24T00:53:16,634           ********************************************************************************

2024-04-24T00:53:16,634   !!
2024-04-24T00:53:16,635     check.warn(importable)
2024-04-24T00:53:16,635   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-04-24T00:53:16,635   !!

2024-04-24T00:53:16,636           ********************************************************************************
2024-04-24T00:53:16,636           ############################
2024-04-24T00:53:16,636           # Package would be ignored #
2024-04-24T00:53:16,637           ############################
2024-04-24T00:53:16,637           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-04-24T00:53:16,637           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,638           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,638           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-04-24T00:53:16,638           to the `packages` configuration field.

2024-04-24T00:53:16,639           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,639           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,639           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,640           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,640           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,641           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-04-24T00:53:16,641           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-04-24T00:53:16,641           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,642           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,642           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,642           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,643           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,644           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,644                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,644                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,645                 directory, all directories are treated like packages.
2024-04-24T00:53:16,645           ********************************************************************************

2024-04-24T00:53:16,645   !!
2024-04-24T00:53:16,646     check.warn(importable)
2024-04-24T00:53:16,646   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-04-24T00:53:16,646   !!

2024-04-24T00:53:16,647           ********************************************************************************
2024-04-24T00:53:16,647           ############################
2024-04-24T00:53:16,648           # Package would be ignored #
2024-04-24T00:53:16,648           ############################
2024-04-24T00:53:16,648           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-04-24T00:53:16,649           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,649           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,649           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-04-24T00:53:16,650           to the `packages` configuration field.

2024-04-24T00:53:16,650           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,650           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,651           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,651           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,652           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,652           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-04-24T00:53:16,653           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-04-24T00:53:16,653           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,653           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,653           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,654           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,655           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,655           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,656                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,656                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,656                 directory, all directories are treated like packages.
2024-04-24T00:53:16,656           ********************************************************************************

2024-04-24T00:53:16,657   !!
2024-04-24T00:53:16,657     check.warn(importable)
2024-04-24T00:53:16,657   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-04-24T00:53:16,658   !!

2024-04-24T00:53:16,658           ********************************************************************************
2024-04-24T00:53:16,659           ############################
2024-04-24T00:53:16,659           # Package would be ignored #
2024-04-24T00:53:16,659           ############################
2024-04-24T00:53:16,659           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-04-24T00:53:16,660           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,660           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,661           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-04-24T00:53:16,661           to the `packages` configuration field.

2024-04-24T00:53:16,661           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,662           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,662           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,662           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,663           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,663           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-04-24T00:53:16,664           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-04-24T00:53:16,664           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,664           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,665           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,665           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,666           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,667           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,667                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,667                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,668                 directory, all directories are treated like packages.
2024-04-24T00:53:16,668           ********************************************************************************

2024-04-24T00:53:16,669   !!
2024-04-24T00:53:16,669     check.warn(importable)
2024-04-24T00:53:16,669   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-04-24T00:53:16,669   !!

2024-04-24T00:53:16,670           ********************************************************************************
2024-04-24T00:53:16,670           ############################
2024-04-24T00:53:16,671           # Package would be ignored #
2024-04-24T00:53:16,671           ############################
2024-04-24T00:53:16,671           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-04-24T00:53:16,671           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,672           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,672           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-04-24T00:53:16,673           to the `packages` configuration field.

2024-04-24T00:53:16,673           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,673           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,674           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,674           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,675           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,675           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-04-24T00:53:16,676           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-04-24T00:53:16,676           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,676           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,677           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,677           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,678           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,678           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,679                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,679                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,679                 directory, all directories are treated like packages.
2024-04-24T00:53:16,679           ********************************************************************************

2024-04-24T00:53:16,680   !!
2024-04-24T00:53:16,680     check.warn(importable)
2024-04-24T00:53:16,681   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-04-24T00:53:16,681   !!

2024-04-24T00:53:16,681           ********************************************************************************
2024-04-24T00:53:16,682           ############################
2024-04-24T00:53:16,682           # Package would be ignored #
2024-04-24T00:53:16,682           ############################
2024-04-24T00:53:16,682           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-04-24T00:53:16,683           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,683           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,684           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-04-24T00:53:16,684           to the `packages` configuration field.

2024-04-24T00:53:16,684           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,685           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,685           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,685           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,686           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,687           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-04-24T00:53:16,687           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-04-24T00:53:16,687           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,687           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,688           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,688           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,689           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,689           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,690                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,690                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,690                 directory, all directories are treated like packages.
2024-04-24T00:53:16,691           ********************************************************************************

2024-04-24T00:53:16,691   !!
2024-04-24T00:53:16,691     check.warn(importable)
2024-04-24T00:53:16,692   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-04-24T00:53:16,692   !!

2024-04-24T00:53:16,692           ********************************************************************************
2024-04-24T00:53:16,693           ############################
2024-04-24T00:53:16,693           # Package would be ignored #
2024-04-24T00:53:16,693           ############################
2024-04-24T00:53:16,693           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-04-24T00:53:16,694           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,694           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,695           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-04-24T00:53:16,695           to the `packages` configuration field.

2024-04-24T00:53:16,695           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,696           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,696           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,696           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,697           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,697           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-04-24T00:53:16,698           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-04-24T00:53:16,698           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,698           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,699           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,699           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,700           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,700           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,701                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,701                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,701                 directory, all directories are treated like packages.
2024-04-24T00:53:16,702           ********************************************************************************

2024-04-24T00:53:16,702   !!
2024-04-24T00:53:16,702     check.warn(importable)
2024-04-24T00:53:16,703   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-04-24T00:53:16,703   !!

2024-04-24T00:53:16,703           ********************************************************************************
2024-04-24T00:53:16,704           ############################
2024-04-24T00:53:16,704           # Package would be ignored #
2024-04-24T00:53:16,704           ############################
2024-04-24T00:53:16,705           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-04-24T00:53:16,705           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,705           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,706           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-04-24T00:53:16,706           to the `packages` configuration field.

2024-04-24T00:53:16,706           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,707           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,707           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,707           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,708           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,709           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-04-24T00:53:16,709           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-04-24T00:53:16,709           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,710           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,710           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,710           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,711           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,712           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,712                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,712                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,713                 directory, all directories are treated like packages.
2024-04-24T00:53:16,713           ********************************************************************************

2024-04-24T00:53:16,714   !!
2024-04-24T00:53:16,714     check.warn(importable)
2024-04-24T00:53:16,714   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-04-24T00:53:16,714   !!

2024-04-24T00:53:16,715           ********************************************************************************
2024-04-24T00:53:16,715           ############################
2024-04-24T00:53:16,716           # Package would be ignored #
2024-04-24T00:53:16,716           ############################
2024-04-24T00:53:16,716           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-04-24T00:53:16,716           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,717           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,717           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-04-24T00:53:16,718           to the `packages` configuration field.

2024-04-24T00:53:16,718           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,718           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,719           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,719           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,720           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,720           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-04-24T00:53:16,720           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-04-24T00:53:16,721           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,721           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,721           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,722           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,722           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,723           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,723                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,724                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,724                 directory, all directories are treated like packages.
2024-04-24T00:53:16,724           ********************************************************************************

2024-04-24T00:53:16,725   !!
2024-04-24T00:53:16,725     check.warn(importable)
2024-04-24T00:53:16,725   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2024-04-24T00:53:16,726   !!

2024-04-24T00:53:16,726           ********************************************************************************
2024-04-24T00:53:16,726           ############################
2024-04-24T00:53:16,727           # Package would be ignored #
2024-04-24T00:53:16,727           ############################
2024-04-24T00:53:16,727           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2024-04-24T00:53:16,727           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,728           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,728           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2024-04-24T00:53:16,729           to the `packages` configuration field.

2024-04-24T00:53:16,729           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,729           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,730           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,730           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,731           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,731           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2024-04-24T00:53:16,731           already explicitly excluding 'deepspeed.ops.csrc.common' via
2024-04-24T00:53:16,732           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,732           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,732           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,733           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,733           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,734           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,734                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,735                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,735                 directory, all directories are treated like packages.
2024-04-24T00:53:16,735           ********************************************************************************

2024-04-24T00:53:16,736   !!
2024-04-24T00:53:16,736     check.warn(importable)
2024-04-24T00:53:16,736   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-04-24T00:53:16,737   !!

2024-04-24T00:53:16,737           ********************************************************************************
2024-04-24T00:53:16,737           ############################
2024-04-24T00:53:16,738           # Package would be ignored #
2024-04-24T00:53:16,738           ############################
2024-04-24T00:53:16,738           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-04-24T00:53:16,738           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,739           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,739           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-04-24T00:53:16,739           to the `packages` configuration field.

2024-04-24T00:53:16,740           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,740           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,741           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,741           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,742           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,742           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-04-24T00:53:16,742           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-04-24T00:53:16,743           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,743           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,743           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,744           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,744           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,745           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,745                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,746                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,746                 directory, all directories are treated like packages.
2024-04-24T00:53:16,746           ********************************************************************************

2024-04-24T00:53:16,747   !!
2024-04-24T00:53:16,747     check.warn(importable)
2024-04-24T00:53:16,747   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-04-24T00:53:16,748   !!

2024-04-24T00:53:16,748           ********************************************************************************
2024-04-24T00:53:16,748           ############################
2024-04-24T00:53:16,749           # Package would be ignored #
2024-04-24T00:53:16,749           ############################
2024-04-24T00:53:16,749           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-04-24T00:53:16,749           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,750           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,750           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-04-24T00:53:16,750           to the `packages` configuration field.

2024-04-24T00:53:16,751           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,751           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,752           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,752           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,753           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,753           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-04-24T00:53:16,754           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-04-24T00:53:16,754           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,754           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,754           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,755           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,756           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,756           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,757                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,757                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,757                 directory, all directories are treated like packages.
2024-04-24T00:53:16,758           ********************************************************************************

2024-04-24T00:53:16,758   !!
2024-04-24T00:53:16,758     check.warn(importable)
2024-04-24T00:53:16,759   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-04-24T00:53:16,759   !!

2024-04-24T00:53:16,760           ********************************************************************************
2024-04-24T00:53:16,760           ############################
2024-04-24T00:53:16,760           # Package would be ignored #
2024-04-24T00:53:16,760           ############################
2024-04-24T00:53:16,761           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-04-24T00:53:16,761           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,762           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,762           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-04-24T00:53:16,762           to the `packages` configuration field.

2024-04-24T00:53:16,763           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,763           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,763           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,764           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,764           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,765           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-04-24T00:53:16,765           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-04-24T00:53:16,765           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,766           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,766           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,766           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,767           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,768           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,768                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,768                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,769                 directory, all directories are treated like packages.
2024-04-24T00:53:16,769           ********************************************************************************

2024-04-24T00:53:16,769   !!
2024-04-24T00:53:16,770     check.warn(importable)
2024-04-24T00:53:16,770   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-04-24T00:53:16,770   !!

2024-04-24T00:53:16,771           ********************************************************************************
2024-04-24T00:53:16,771           ############################
2024-04-24T00:53:16,771           # Package would be ignored #
2024-04-24T00:53:16,772           ############################
2024-04-24T00:53:16,772           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-04-24T00:53:16,772           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,773           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,773           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-04-24T00:53:16,773           to the `packages` configuration field.

2024-04-24T00:53:16,774           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,774           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,774           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,775           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,775           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,776           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-04-24T00:53:16,776           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-04-24T00:53:16,776           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,777           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,777           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,777           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,778           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,779           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,779                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,779                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,780                 directory, all directories are treated like packages.
2024-04-24T00:53:16,780           ********************************************************************************

2024-04-24T00:53:16,780   !!
2024-04-24T00:53:16,781     check.warn(importable)
2024-04-24T00:53:16,781   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-04-24T00:53:16,781   !!

2024-04-24T00:53:16,782           ********************************************************************************
2024-04-24T00:53:16,782           ############################
2024-04-24T00:53:16,782           # Package would be ignored #
2024-04-24T00:53:16,783           ############################
2024-04-24T00:53:16,783           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-04-24T00:53:16,783           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,784           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,784           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-04-24T00:53:16,784           to the `packages` configuration field.

2024-04-24T00:53:16,785           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,785           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,785           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,786           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,786           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,787           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-04-24T00:53:16,787           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-04-24T00:53:16,787           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,788           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,788           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,788           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,789           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,790           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,790                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,790                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,791                 directory, all directories are treated like packages.
2024-04-24T00:53:16,791           ********************************************************************************

2024-04-24T00:53:16,791   !!
2024-04-24T00:53:16,792     check.warn(importable)
2024-04-24T00:53:16,792   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-04-24T00:53:16,792   !!

2024-04-24T00:53:16,793           ********************************************************************************
2024-04-24T00:53:16,793           ############################
2024-04-24T00:53:16,793           # Package would be ignored #
2024-04-24T00:53:16,794           ############################
2024-04-24T00:53:16,794           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-04-24T00:53:16,794           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,795           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,795           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-04-24T00:53:16,795           to the `packages` configuration field.

2024-04-24T00:53:16,796           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,796           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,797           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,797           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,798           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,798           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-04-24T00:53:16,799           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-04-24T00:53:16,799           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,799           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,799           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,800           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,800           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,801           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,802                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,802                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,802                 directory, all directories are treated like packages.
2024-04-24T00:53:16,802           ********************************************************************************

2024-04-24T00:53:16,803   !!
2024-04-24T00:53:16,803     check.warn(importable)
2024-04-24T00:53:16,803   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-04-24T00:53:16,804   !!

2024-04-24T00:53:16,804           ********************************************************************************
2024-04-24T00:53:16,805           ############################
2024-04-24T00:53:16,805           # Package would be ignored #
2024-04-24T00:53:16,805           ############################
2024-04-24T00:53:16,805           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-04-24T00:53:16,806           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,806           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,806           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-04-24T00:53:16,807           to the `packages` configuration field.

2024-04-24T00:53:16,807           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,808           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,808           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,808           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,809           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,809           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-04-24T00:53:16,810           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-04-24T00:53:16,810           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,810           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,810           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,811           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,812           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,812           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,813                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,813                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,813                 directory, all directories are treated like packages.
2024-04-24T00:53:16,813           ********************************************************************************

2024-04-24T00:53:16,814   !!
2024-04-24T00:53:16,814     check.warn(importable)
2024-04-24T00:53:16,815   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-04-24T00:53:16,815   !!

2024-04-24T00:53:16,815           ********************************************************************************
2024-04-24T00:53:16,816           ############################
2024-04-24T00:53:16,816           # Package would be ignored #
2024-04-24T00:53:16,816           ############################
2024-04-24T00:53:16,816           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-04-24T00:53:16,817           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,817           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,818           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-04-24T00:53:16,818           to the `packages` configuration field.

2024-04-24T00:53:16,818           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,819           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,819           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,819           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,820           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,820           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-04-24T00:53:16,821           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-04-24T00:53:16,821           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,821           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,821           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,822           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,823           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,823           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,824                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,824                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,824                 directory, all directories are treated like packages.
2024-04-24T00:53:16,824           ********************************************************************************

2024-04-24T00:53:16,825   !!
2024-04-24T00:53:16,825     check.warn(importable)
2024-04-24T00:53:16,825   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-04-24T00:53:16,826   !!

2024-04-24T00:53:16,826           ********************************************************************************
2024-04-24T00:53:16,827           ############################
2024-04-24T00:53:16,827           # Package would be ignored #
2024-04-24T00:53:16,827           ############################
2024-04-24T00:53:16,827           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-04-24T00:53:16,828           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,828           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,829           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-04-24T00:53:16,829           to the `packages` configuration field.

2024-04-24T00:53:16,829           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,830           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,830           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,830           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,831           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,831           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-04-24T00:53:16,832           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-04-24T00:53:16,832           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,832           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,833           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,833           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,834           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,834           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,835                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,835                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,835                 directory, all directories are treated like packages.
2024-04-24T00:53:16,835           ********************************************************************************

2024-04-24T00:53:16,836   !!
2024-04-24T00:53:16,836     check.warn(importable)
2024-04-24T00:53:16,837   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-04-24T00:53:16,837   !!

2024-04-24T00:53:16,838           ********************************************************************************
2024-04-24T00:53:16,838           ############################
2024-04-24T00:53:16,838           # Package would be ignored #
2024-04-24T00:53:16,838           ############################
2024-04-24T00:53:16,839           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-04-24T00:53:16,839           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,840           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,840           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-04-24T00:53:16,840           to the `packages` configuration field.

2024-04-24T00:53:16,841           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,841           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,841           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,842           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,842           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,843           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-04-24T00:53:16,843           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-04-24T00:53:16,843           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,844           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,844           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,845           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,845           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,846           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,846                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,846                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,847                 directory, all directories are treated like packages.
2024-04-24T00:53:16,847           ********************************************************************************

2024-04-24T00:53:16,848   !!
2024-04-24T00:53:16,848     check.warn(importable)
2024-04-24T00:53:16,848   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-04-24T00:53:16,848   !!

2024-04-24T00:53:16,849           ********************************************************************************
2024-04-24T00:53:16,849           ############################
2024-04-24T00:53:16,849           # Package would be ignored #
2024-04-24T00:53:16,850           ############################
2024-04-24T00:53:16,850           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-04-24T00:53:16,850           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,851           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,851           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-04-24T00:53:16,851           to the `packages` configuration field.

2024-04-24T00:53:16,852           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,852           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,852           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,853           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,854           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,854           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-04-24T00:53:16,854           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-04-24T00:53:16,855           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,855           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,855           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,856           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,856           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,857           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,858                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,858                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,858                 directory, all directories are treated like packages.
2024-04-24T00:53:16,858           ********************************************************************************

2024-04-24T00:53:16,859   !!
2024-04-24T00:53:16,859     check.warn(importable)
2024-04-24T00:53:16,859   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-04-24T00:53:16,860   !!

2024-04-24T00:53:16,860           ********************************************************************************
2024-04-24T00:53:16,861           ############################
2024-04-24T00:53:16,861           # Package would be ignored #
2024-04-24T00:53:16,861           ############################
2024-04-24T00:53:16,861           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-04-24T00:53:16,862           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,862           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,863           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-04-24T00:53:16,863           to the `packages` configuration field.

2024-04-24T00:53:16,863           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,864           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,864           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,864           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,865           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,866           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-04-24T00:53:16,866           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-04-24T00:53:16,866           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,866           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,867           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,867           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,868           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,869           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,869                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,869                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,869                 directory, all directories are treated like packages.
2024-04-24T00:53:16,870           ********************************************************************************

2024-04-24T00:53:16,870   !!
2024-04-24T00:53:16,871     check.warn(importable)
2024-04-24T00:53:16,871   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-04-24T00:53:16,871   !!

2024-04-24T00:53:16,872           ********************************************************************************
2024-04-24T00:53:16,872           ############################
2024-04-24T00:53:16,872           # Package would be ignored #
2024-04-24T00:53:16,872           ############################
2024-04-24T00:53:16,873           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-04-24T00:53:16,873           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,874           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,874           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-04-24T00:53:16,874           to the `packages` configuration field.

2024-04-24T00:53:16,875           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,875           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,875           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,876           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,876           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,877           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-04-24T00:53:16,877           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-04-24T00:53:16,877           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,878           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,878           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,879           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,879           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,880           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,880                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,880                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,881                 directory, all directories are treated like packages.
2024-04-24T00:53:16,881           ********************************************************************************

2024-04-24T00:53:16,882   !!
2024-04-24T00:53:16,882     check.warn(importable)
2024-04-24T00:53:16,882   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-04-24T00:53:16,883   !!

2024-04-24T00:53:16,883           ********************************************************************************
2024-04-24T00:53:16,883           ############################
2024-04-24T00:53:16,884           # Package would be ignored #
2024-04-24T00:53:16,884           ############################
2024-04-24T00:53:16,884           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-04-24T00:53:16,884           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,885           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,885           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-04-24T00:53:16,886           to the `packages` configuration field.

2024-04-24T00:53:16,886           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,886           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,887           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,887           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,888           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,888           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-04-24T00:53:16,889           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-04-24T00:53:16,889           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,889           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,889           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,890           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,891           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,891           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,892                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,892                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,892                 directory, all directories are treated like packages.
2024-04-24T00:53:16,893           ********************************************************************************

2024-04-24T00:53:16,893   !!
2024-04-24T00:53:16,893     check.warn(importable)
2024-04-24T00:53:16,894   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-04-24T00:53:16,894   !!

2024-04-24T00:53:16,894           ********************************************************************************
2024-04-24T00:53:16,895           ############################
2024-04-24T00:53:16,895           # Package would be ignored #
2024-04-24T00:53:16,895           ############################
2024-04-24T00:53:16,896           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-04-24T00:53:16,896           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,897           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,897           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-04-24T00:53:16,897           to the `packages` configuration field.

2024-04-24T00:53:16,898           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,898           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,898           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,899           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,899           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,900           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-04-24T00:53:16,900           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-04-24T00:53:16,900           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,901           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,901           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,902           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,902           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,903           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,903                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,903                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,904                 directory, all directories are treated like packages.
2024-04-24T00:53:16,904           ********************************************************************************

2024-04-24T00:53:16,905   !!
2024-04-24T00:53:16,905     check.warn(importable)
2024-04-24T00:53:16,905   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-04-24T00:53:16,905   !!

2024-04-24T00:53:16,906           ********************************************************************************
2024-04-24T00:53:16,906           ############################
2024-04-24T00:53:16,906           # Package would be ignored #
2024-04-24T00:53:16,907           ############################
2024-04-24T00:53:16,907           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-04-24T00:53:16,907           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,908           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,908           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-04-24T00:53:16,908           to the `packages` configuration field.

2024-04-24T00:53:16,909           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,909           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,910           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,910           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,911           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,911           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-04-24T00:53:16,911           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-04-24T00:53:16,912           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,912           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,912           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,913           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,913           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,914           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,915                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,915                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,915                 directory, all directories are treated like packages.
2024-04-24T00:53:16,916           ********************************************************************************

2024-04-24T00:53:16,916   !!
2024-04-24T00:53:16,917     check.warn(importable)
2024-04-24T00:53:16,917   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-04-24T00:53:16,917   !!

2024-04-24T00:53:16,918           ********************************************************************************
2024-04-24T00:53:16,918           ############################
2024-04-24T00:53:16,918           # Package would be ignored #
2024-04-24T00:53:16,919           ############################
2024-04-24T00:53:16,919           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-04-24T00:53:16,919           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,920           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,920           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-04-24T00:53:16,921           to the `packages` configuration field.

2024-04-24T00:53:16,921           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,922           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,922           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,923           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,923           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,924           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-04-24T00:53:16,924           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-04-24T00:53:16,924           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,925           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,925           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,926           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,926           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,927           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,928                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,928                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,928                 directory, all directories are treated like packages.
2024-04-24T00:53:16,929           ********************************************************************************

2024-04-24T00:53:16,929   !!
2024-04-24T00:53:16,930     check.warn(importable)
2024-04-24T00:53:16,930   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-04-24T00:53:16,930   !!

2024-04-24T00:53:16,931           ********************************************************************************
2024-04-24T00:53:16,931           ############################
2024-04-24T00:53:16,931           # Package would be ignored #
2024-04-24T00:53:16,932           ############################
2024-04-24T00:53:16,932           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-04-24T00:53:16,932           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,933           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,934           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-04-24T00:53:16,934           to the `packages` configuration field.

2024-04-24T00:53:16,934           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,935           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,935           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,936           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,936           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,937           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-04-24T00:53:16,937           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-04-24T00:53:16,938           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,938           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,938           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,939           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,939           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,940           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,941                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,941                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,941                 directory, all directories are treated like packages.
2024-04-24T00:53:16,942           ********************************************************************************

2024-04-24T00:53:16,943   !!
2024-04-24T00:53:16,943     check.warn(importable)
2024-04-24T00:53:16,944   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-04-24T00:53:16,944   !!

2024-04-24T00:53:16,945           ********************************************************************************
2024-04-24T00:53:16,945           ############################
2024-04-24T00:53:16,945           # Package would be ignored #
2024-04-24T00:53:16,945           ############################
2024-04-24T00:53:16,946           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-04-24T00:53:16,946           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,947           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,948           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-04-24T00:53:16,948           to the `packages` configuration field.

2024-04-24T00:53:16,949           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,949           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,949           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,950           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,950           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,951           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-04-24T00:53:16,951           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-04-24T00:53:16,952           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,952           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,952           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,953           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,954           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,954           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,955                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,955                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,956                 directory, all directories are treated like packages.
2024-04-24T00:53:16,956           ********************************************************************************

2024-04-24T00:53:16,957   !!
2024-04-24T00:53:16,957     check.warn(importable)
2024-04-24T00:53:16,958   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-04-24T00:53:16,958   !!

2024-04-24T00:53:16,959           ********************************************************************************
2024-04-24T00:53:16,959           ############################
2024-04-24T00:53:16,959           # Package would be ignored #
2024-04-24T00:53:16,960           ############################
2024-04-24T00:53:16,960           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-04-24T00:53:16,960           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,961           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,961           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-04-24T00:53:16,961           to the `packages` configuration field.

2024-04-24T00:53:16,962           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,962           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,963           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,963           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,964           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,965           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-04-24T00:53:16,965           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-04-24T00:53:16,965           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,966           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,966           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,967           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,967           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,968           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,968                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,969                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,969                 directory, all directories are treated like packages.
2024-04-24T00:53:16,969           ********************************************************************************

2024-04-24T00:53:16,970   !!
2024-04-24T00:53:16,970     check.warn(importable)
2024-04-24T00:53:16,971   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-04-24T00:53:16,971   !!

2024-04-24T00:53:16,972           ********************************************************************************
2024-04-24T00:53:16,972           ############################
2024-04-24T00:53:16,972           # Package would be ignored #
2024-04-24T00:53:16,973           ############################
2024-04-24T00:53:16,973           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-04-24T00:53:16,973           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,974           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,975           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-04-24T00:53:16,975           to the `packages` configuration field.

2024-04-24T00:53:16,976           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,976           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,976           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,977           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,977           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,978           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-04-24T00:53:16,978           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-04-24T00:53:16,979           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,980           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,980           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,981           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,981           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,982           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,983                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,983                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,983                 directory, all directories are treated like packages.
2024-04-24T00:53:16,984           ********************************************************************************

2024-04-24T00:53:16,984   !!
2024-04-24T00:53:16,984     check.warn(importable)
2024-04-24T00:53:16,985   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-04-24T00:53:16,985   !!

2024-04-24T00:53:16,986           ********************************************************************************
2024-04-24T00:53:16,987           ############################
2024-04-24T00:53:16,987           # Package would be ignored #
2024-04-24T00:53:16,987           ############################
2024-04-24T00:53:16,988           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-04-24T00:53:16,988           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:16,988           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:16,989           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-04-24T00:53:16,989           to the `packages` configuration field.

2024-04-24T00:53:16,990           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:16,990           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:16,991           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:16,991           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:16,992           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:16,993           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-04-24T00:53:16,993           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-04-24T00:53:16,993           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:16,993           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:16,994           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:16,995           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:16,995           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:16,996           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:16,997                 even if it does not contain any `.py` files.
2024-04-24T00:53:16,997                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:16,997                 directory, all directories are treated like packages.
2024-04-24T00:53:16,998           ********************************************************************************

2024-04-24T00:53:16,998   !!
2024-04-24T00:53:16,999     check.warn(importable)
2024-04-24T00:53:16,999   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-04-24T00:53:17,000   !!

2024-04-24T00:53:17,000           ********************************************************************************
2024-04-24T00:53:17,000           ############################
2024-04-24T00:53:17,001           # Package would be ignored #
2024-04-24T00:53:17,001           ############################
2024-04-24T00:53:17,001           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-04-24T00:53:17,002           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:17,003           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:17,003           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-04-24T00:53:17,004           to the `packages` configuration field.

2024-04-24T00:53:17,004           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:17,005           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:17,005           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:17,006           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:17,006           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:17,007           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-04-24T00:53:17,007           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-04-24T00:53:17,008           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:17,008           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:17,008           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:17,009           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:17,010           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:17,011           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:17,011                 even if it does not contain any `.py` files.
2024-04-24T00:53:17,011                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:17,012                 directory, all directories are treated like packages.
2024-04-24T00:53:17,012           ********************************************************************************

2024-04-24T00:53:17,013   !!
2024-04-24T00:53:17,014     check.warn(importable)
2024-04-24T00:53:17,014   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-04-24T00:53:17,014   !!

2024-04-24T00:53:17,015           ********************************************************************************
2024-04-24T00:53:17,015           ############################
2024-04-24T00:53:17,015           # Package would be ignored #
2024-04-24T00:53:17,016           ############################
2024-04-24T00:53:17,016           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-04-24T00:53:17,016           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:17,017           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:17,017           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-04-24T00:53:17,018           to the `packages` configuration field.

2024-04-24T00:53:17,018           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:17,019           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:17,019           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:17,020           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:17,020           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:17,021           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-04-24T00:53:17,021           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-04-24T00:53:17,022           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:17,022           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:17,022           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:17,023           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:17,024           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:17,025           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:17,025                 even if it does not contain any `.py` files.
2024-04-24T00:53:17,025                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:17,025                 directory, all directories are treated like packages.
2024-04-24T00:53:17,026           ********************************************************************************

2024-04-24T00:53:17,027   !!
2024-04-24T00:53:17,027     check.warn(importable)
2024-04-24T00:53:17,027   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-04-24T00:53:17,028   !!

2024-04-24T00:53:17,028           ********************************************************************************
2024-04-24T00:53:17,028           ############################
2024-04-24T00:53:17,029           # Package would be ignored #
2024-04-24T00:53:17,029           ############################
2024-04-24T00:53:17,029           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-04-24T00:53:17,030           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:17,030           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:17,031           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-04-24T00:53:17,031           to the `packages` configuration field.

2024-04-24T00:53:17,031           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:17,032           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:17,032           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:17,033           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:17,033           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:17,034           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-04-24T00:53:17,035           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-04-24T00:53:17,035           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:17,035           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:17,035           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:17,036           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:17,037           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:17,038           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:17,038                 even if it does not contain any `.py` files.
2024-04-24T00:53:17,038                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:17,039                 directory, all directories are treated like packages.
2024-04-24T00:53:17,039           ********************************************************************************

2024-04-24T00:53:17,040   !!
2024-04-24T00:53:17,040     check.warn(importable)
2024-04-24T00:53:17,040   /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-04-24T00:53:17,041   !!

2024-04-24T00:53:17,041           ********************************************************************************
2024-04-24T00:53:17,042           ############################
2024-04-24T00:53:17,042           # Package would be ignored #
2024-04-24T00:53:17,042           ############################
2024-04-24T00:53:17,042           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-04-24T00:53:17,043           but it is absent from setuptools' `packages` configuration.

2024-04-24T00:53:17,043           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-24T00:53:17,044           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-04-24T00:53:17,044           to the `packages` configuration field.

2024-04-24T00:53:17,045           Alternatively, you can also rely on setuptools' discovery methods
2024-04-24T00:53:17,045           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-24T00:53:17,045           instead of `find_packages(...)`/`find:`).

2024-04-24T00:53:17,046           You can read more about "package discovery" on setuptools documentation page:

2024-04-24T00:53:17,047           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-24T00:53:17,047           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-04-24T00:53:17,047           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-04-24T00:53:17,048           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-24T00:53:17,048           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-24T00:53:17,048           combination with a more fine grained `package-data` configuration.

2024-04-24T00:53:17,049           You can read more about "package data files" on setuptools documentation page:

2024-04-24T00:53:17,050           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-24T00:53:17,050           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-24T00:53:17,051                 even if it does not contain any `.py` files.
2024-04-24T00:53:17,051                 On the other hand, currently there is no concept of package data
2024-04-24T00:53:17,051                 directory, all directories are treated like packages.
2024-04-24T00:53:17,052           ********************************************************************************

2024-04-24T00:53:17,052   !!
2024-04-24T00:53:17,053     check.warn(importable)
2024-04-24T00:53:17,053   creating build/lib/deepspeed/ops/csrc
2024-04-24T00:53:17,053   creating build/lib/deepspeed/ops/csrc/adagrad
2024-04-24T00:53:17,054   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-04-24T00:53:17,054   creating build/lib/deepspeed/ops/csrc/adam
2024-04-24T00:53:17,054   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-04-24T00:53:17,054   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-04-24T00:53:17,055   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-04-24T00:53:17,055   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-04-24T00:53:17,055   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-04-24T00:53:17,056   creating build/lib/deepspeed/ops/csrc/aio
2024-04-24T00:53:17,056   creating build/lib/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:17,056   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:17,057   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:17,057   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:17,057   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:17,058   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:17,058   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:17,058   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,059   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,059   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,059   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,060   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,060   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,061   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,061   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,061   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,062   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,062   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,062   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:17,063   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-04-24T00:53:17,063   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-04-24T00:53:17,063   creating build/lib/deepspeed/ops/csrc/common
2024-04-24T00:53:17,064   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2024-04-24T00:53:17,064   creating build/lib/deepspeed/ops/csrc/cpu
2024-04-24T00:53:17,065   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-04-24T00:53:17,066   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-04-24T00:53:17,066   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:17,067   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:17,067   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:17,069   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:17,073   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:17,077   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-04-24T00:53:17,078   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-04-24T00:53:17,083   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-04-24T00:53:17,083   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:17,086   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:17,090   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:17,095   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:17,100   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:17,105   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:17,115   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:17,122   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:17,124   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:17,130   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:17,136   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:17,141   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:17,146   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:17,148   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:17,153   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:17,158   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:17,165   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:17,170   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:17,175   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:17,181   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:17,191   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:17,193   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:17,199   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:17,204   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:17,214   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:17,222   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:17,230   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:17,235   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:17,241   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-04-24T00:53:17,243   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-04-24T00:53:17,249   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-04-24T00:53:17,255   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-04-24T00:53:17,257   copying deepspeed/ops/csrc/fp_quantizer/quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-04-24T00:53:17,262   copying deepspeed/ops/csrc/fp_quantizer/quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-04-24T00:53:17,269   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-04-24T00:53:17,272   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-04-24T00:53:17,277   copying deepspeed/ops/csrc/fp_quantizer/includes/quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-04-24T00:53:17,282   creating build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,285   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,290   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,294   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,299   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,303   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,309   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,314   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,319   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,325   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,331   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,335   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,341   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,347   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,351   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,356   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,361   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,366   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,371   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,377   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,381   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,388   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,393   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,399   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,405   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,410   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,415   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,421   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,426   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,431   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-04-24T00:53:17,435   creating build/lib/deepspeed/ops/csrc/lamb
2024-04-24T00:53:17,437   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-04-24T00:53:17,441   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-04-24T00:53:17,446   creating build/lib/deepspeed/ops/csrc/lion
2024-04-24T00:53:17,448   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-04-24T00:53:17,452   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-04-24T00:53:17,457   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-04-24T00:53:17,461   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-04-24T00:53:17,466   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-04-24T00:53:17,471   creating build/lib/deepspeed/ops/csrc/quantization
2024-04-24T00:53:17,473   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-04-24T00:53:17,477   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-04-24T00:53:17,485   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-04-24T00:53:17,490   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-04-24T00:53:17,495   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-04-24T00:53:17,501   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-04-24T00:53:17,506   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-04-24T00:53:17,511   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:17,513   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:17,518   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:17,523   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:17,528   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:17,533   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-04-24T00:53:17,535   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-04-24T00:53:17,540   creating build/lib/deepspeed/ops/csrc/spatial
2024-04-24T00:53:17,541   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-04-24T00:53:17,543   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-04-24T00:53:17,548   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-04-24T00:53:17,553   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-04-24T00:53:17,554   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-04-24T00:53:17,559   creating build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,561   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,567   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,574   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,583   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,588   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,593   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,602   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,609   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-04-24T00:53:17,614   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-04-24T00:53:17,615   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,618   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,623   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,628   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,633   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,638   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,643   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,652   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,656   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,661   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,667   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:17,674   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-04-24T00:53:17,676   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-04-24T00:53:17,681   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-04-24T00:53:17,687   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-04-24T00:53:17,692   creating build/lib/deepspeed/ops/csrc/utils
2024-04-24T00:53:17,694   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-04-24T00:53:17,699   creating build/lib/deepspeed/ops/csrc/xpu
2024-04-24T00:53:17,699   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-04-24T00:53:17,702   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-04-24T00:53:17,707   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:17,709   copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:17,713   copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:17,718   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:17,722   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:17,727   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-04-24T00:53:17,728   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-04-24T00:53:17,733   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:17,734   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:17,739   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:17,743   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:17,748   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:17,753   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:17,758   creating build/lib/deepspeed/autotuning/config_templates
2024-04-24T00:53:17,759   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-04-24T00:53:17,764   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-04-24T00:53:17,768   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-04-24T00:53:17,772   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-04-24T00:53:17,777   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:17,781   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:17,786   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:17,790   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-04-24T00:53:17,792   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-04-24T00:53:17,797   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-04-24T00:53:17,801   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-04-24T00:53:17,803   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-04-24T00:53:17,807   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:17,809   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:17,813   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:17,819   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:17,824   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:17,832   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:17,838   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-04-24T00:53:17,842   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-04-24T00:53:17,845   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-04-24T00:53:17,850   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-04-24T00:53:17,852   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-04-24T00:53:17,857   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-04-24T00:53:17,862   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-04-24T00:53:17,867   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-04-24T00:53:17,872   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-04-24T00:53:17,877   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-04-24T00:53:17,879   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-04-24T00:53:17,884   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:17,889   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:17,894   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:17,899   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:17,904   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:17,908   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:17,913   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:17,918   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:17,923   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:17,927   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:17,931   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:17,936   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:17,940   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:17,944   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:17,949   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:17,954   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:17,958   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:17,962   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:17,966   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:17,970   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:17,975   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:17,979   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:17,984   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:17,988   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:17,992   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:17,996   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:18,001   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:18,005   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:18,010   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:18,014   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:18,019   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:18,024   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:18,028   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:18,034   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:18,039   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:18,043   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:18,048   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:18,052   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:18,056   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:18,061   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:18,065   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:18,070   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:18,074   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:18,079   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:18,083   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:18,089   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:18,094   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,095   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,100   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,105   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,110   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,114   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,118   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,123   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,128   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,132   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:18,137   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:18,141   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:18,146   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:18,151   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:18,155   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:18,159   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:18,164   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:18,168   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:18,322   running build_scripts
2024-04-24T00:53:18,324   creating build/scripts-3.7
2024-04-24T00:53:18,326   copying and adjusting bin/deepspeed -> build/scripts-3.7
2024-04-24T00:53:18,329   copying and adjusting bin/deepspeed.pt -> build/scripts-3.7
2024-04-24T00:53:18,332   copying and adjusting bin/ds -> build/scripts-3.7
2024-04-24T00:53:18,335   copying bin/ds_ssh -> build/scripts-3.7
2024-04-24T00:53:18,340   copying and adjusting bin/ds_report -> build/scripts-3.7
2024-04-24T00:53:18,342   copying and adjusting bin/ds_bench -> build/scripts-3.7
2024-04-24T00:53:18,346   copying and adjusting bin/dsr -> build/scripts-3.7
2024-04-24T00:53:18,348   copying and adjusting bin/ds_elastic -> build/scripts-3.7
2024-04-24T00:53:18,350   changing mode of build/scripts-3.7/deepspeed from 644 to 755
2024-04-24T00:53:18,351   changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755
2024-04-24T00:53:18,352   changing mode of build/scripts-3.7/ds from 644 to 755
2024-04-24T00:53:18,352   changing mode of build/scripts-3.7/ds_report from 644 to 755
2024-04-24T00:53:18,353   changing mode of build/scripts-3.7/ds_bench from 644 to 755
2024-04-24T00:53:18,354   changing mode of build/scripts-3.7/dsr from 644 to 755
2024-04-24T00:53:18,354   changing mode of build/scripts-3.7/ds_elastic from 644 to 755
2024-04-24T00:53:18,411   /usr/local/lib/python3.7/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-04-24T00:53:18,412   !!

2024-04-24T00:53:18,412           ********************************************************************************
2024-04-24T00:53:18,413           Please avoid running ``setup.py`` directly.
2024-04-24T00:53:18,413           Instead, use pypa/build, pypa/installer or other
2024-04-24T00:53:18,413           standards-based tools.

2024-04-24T00:53:18,414           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-04-24T00:53:18,414           ********************************************************************************

2024-04-24T00:53:18,415   !!
2024-04-24T00:53:18,415     self.initialize_options()
2024-04-24T00:53:18,468   installing to build/bdist.linux-armv7l/wheel
2024-04-24T00:53:18,468   running install
2024-04-24T00:53:18,530   running install_lib
2024-04-24T00:53:18,597   creating build/bdist.linux-armv7l
2024-04-24T00:53:18,598   creating build/bdist.linux-armv7l/wheel
2024-04-24T00:53:18,603   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-04-24T00:53:18,606   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-04-24T00:53:18,608   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-04-24T00:53:18,612   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-04-24T00:53:18,616   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-04-24T00:53:18,622   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-04-24T00:53:18,624   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-04-24T00:53:18,630   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-04-24T00:53:18,634   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-04-24T00:53:18,638   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-04-24T00:53:18,643   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-04-24T00:53:18,648   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-04-24T00:53:18,653   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,655   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,659   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,663   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,667   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,671   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,675   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,678   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,682   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,686   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,691   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-04-24T00:53:18,695   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-04-24T00:53:18,700   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-04-24T00:53:18,701   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-04-24T00:53:18,707   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-04-24T00:53:18,710   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-04-24T00:53:18,714   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-04-24T00:53:18,718   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-04-24T00:53:18,721   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-04-24T00:53:18,727   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-04-24T00:53:18,730   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-04-24T00:53:18,731   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-04-24T00:53:18,735   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-04-24T00:53:18,740   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-04-24T00:53:18,742   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-04-24T00:53:18,746   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-04-24T00:53:18,750   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-04-24T00:53:18,752   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-04-24T00:53:18,756   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-04-24T00:53:18,761   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-04-24T00:53:18,765   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-04-24T00:53:18,767   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-04-24T00:53:18,770   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-04-24T00:53:18,775   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-04-24T00:53:18,778   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-04-24T00:53:18,784   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-04-24T00:53:18,786   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-04-24T00:53:18,790   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-04-24T00:53:18,796   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,798   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,803   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:18,804   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:18,809   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:18,812   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:18,815   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:18,819   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:18,822   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-04-24T00:53:18,826   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,829   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,835   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,839   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,842   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,846   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,850   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,853   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,857   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,860   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,864   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,868   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,871   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,876   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:18,878   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:18,881   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:18,885   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:18,888   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:18,892   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:18,895   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-04-24T00:53:18,899   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,902   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,905   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,909   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,913   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,916   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,921   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:18,922   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:18,926   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:18,929   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:18,933   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:18,936   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-04-24T00:53:18,940   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,943   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,948   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,950   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,953   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,957   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,962   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,965   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,969   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,973   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,977   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,980   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-04-24T00:53:18,984   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-04-24T00:53:18,989   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-04-24T00:53:18,991   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-04-24T00:53:18,995   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-04-24T00:53:19,000   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-04-24T00:53:19,002   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-04-24T00:53:19,006   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-04-24T00:53:19,011   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-04-24T00:53:19,014   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-04-24T00:53:19,020   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-04-24T00:53:19,021   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-04-24T00:53:19,026   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-04-24T00:53:19,031   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-04-24T00:53:19,033   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-04-24T00:53:19,038   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-04-24T00:53:19,039   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-04-24T00:53:19,045   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:19,047   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:19,052   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:19,056   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:19,059   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-04-24T00:53:19,064   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-04-24T00:53:19,068   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-04-24T00:53:19,074   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-04-24T00:53:19,079   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-04-24T00:53:19,085   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-04-24T00:53:19,091   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-04-24T00:53:19,097   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-04-24T00:53:19,099   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-04-24T00:53:19,104   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-04-24T00:53:19,110   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,112   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,117   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,122   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,127   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,132   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,137   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,140   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,144   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,150   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,152   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,156   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,161   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,164   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,168   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,172   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,178   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,181   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,186   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,191   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-04-24T00:53:19,196   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,202   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,203   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,208   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,212   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,216   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,220   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,223   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,227   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,231   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,235   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,239   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-04-24T00:53:19,242   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-04-24T00:53:19,248   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-04-24T00:53:19,251   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-04-24T00:53:19,253   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-04-24T00:53:19,258   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-04-24T00:53:19,262   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-04-24T00:53:19,269   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-04-24T00:53:19,273   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-04-24T00:53:19,277   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-04-24T00:53:19,282   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-04-24T00:53:19,287   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-04-24T00:53:19,290   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:19,292   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:19,298   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:19,301   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:19,305   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-04-24T00:53:19,310   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-04-24T00:53:19,311   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-04-24T00:53:19,317   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-04-24T00:53:19,319   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-04-24T00:53:19,324   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:19,326   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:19,331   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:19,334   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:19,338   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:19,343   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-04-24T00:53:19,349   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-04-24T00:53:19,352   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-04-24T00:53:19,355   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-04-24T00:53:19,360   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-04-24T00:53:19,365   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-04-24T00:53:19,368   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-04-24T00:53:19,373   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:19,376   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:19,381   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:19,386   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:19,391   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-04-24T00:53:19,397   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-04-24T00:53:19,399   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-04-24T00:53:19,404   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-04-24T00:53:19,410   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-04-24T00:53:19,413   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-04-24T00:53:19,418   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-04-24T00:53:19,422   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-04-24T00:53:19,427   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-04-24T00:53:19,431   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-04-24T00:53:19,438   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-04-24T00:53:19,441   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-04-24T00:53:19,447   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-04-24T00:53:19,449   copying build/lib/deepspeed/ops/csrc/fp_quantizer/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-04-24T00:53:19,456   copying build/lib/deepspeed/ops/csrc/fp_quantizer/quantize.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-04-24T00:53:19,462   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-04-24T00:53:19,463   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-04-24T00:53:19,468   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/quantize.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-04-24T00:53:19,473   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-04-24T00:53:19,474   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-04-24T00:53:19,479   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-04-24T00:53:19,482   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-04-24T00:53:19,484   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-04-24T00:53:19,489   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:19,491   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:19,496   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:19,500   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:19,504   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-04-24T00:53:19,509   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-04-24T00:53:19,511   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-04-24T00:53:19,515   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-04-24T00:53:19,517   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-04-24T00:53:19,521   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-04-24T00:53:19,525   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-04-24T00:53:19,529   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-04-24T00:53:19,534   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-04-24T00:53:19,538   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-04-24T00:53:19,542   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:19,543   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:19,553   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:19,557   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:19,562   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:19,566   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:19,571   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-04-24T00:53:19,573   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-04-24T00:53:19,577   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-04-24T00:53:19,584   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:19,586   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:19,591   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:19,596   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:19,600   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-04-24T00:53:19,605   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-04-24T00:53:19,613   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:19,614   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:19,622   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:19,626   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:19,633   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:19,639   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:19,648   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:19,653   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-04-24T00:53:19,659   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:19,661   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:19,667   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:19,676   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:19,682   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:19,687   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:19,692   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:19,699   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-04-24T00:53:19,705   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-04-24T00:53:19,708   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-04-24T00:53:19,710   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-04-24T00:53:19,715   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:19,717   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:19,721   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:19,725   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:19,729   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:19,732   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:19,737   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-04-24T00:53:19,742   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,744   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,753   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,757   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,761   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,765   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,768   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,772   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,775   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,779   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,783   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,787   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-04-24T00:53:19,792   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-04-24T00:53:19,793   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-04-24T00:53:19,799   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,800   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,807   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,815   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,820   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,825   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,831   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,839   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-04-24T00:53:19,841   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,843   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,848   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,855   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,859   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,865   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,875   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,881   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,885   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,890   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,894   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-04-24T00:53:19,899   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-04-24T00:53:19,901   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-04-24T00:53:19,905   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-04-24T00:53:19,910   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-04-24T00:53:19,915   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,923   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-04-24T00:53:19,929   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-04-24T00:53:19,930   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-04-24T00:53:19,936   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,938   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,942   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,946   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,951   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,954   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,958   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,962   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,965   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,970   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,974   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,978   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,982   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,988   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,992   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:19,996   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,000   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,005   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,009   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,013   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,017   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,022   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,027   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,032   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,036   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,040   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,044   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,047   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,050   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,054   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-04-24T00:53:20,058   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-04-24T00:53:20,061   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-04-24T00:53:20,068   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,070   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,074   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,080   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,082   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,087   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,092   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,095   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,099   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,103   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,106   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,111   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,116   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-04-24T00:53:20,121   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,124   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,129   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,132   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,137   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,139   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,144   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,155   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,160   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,164   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,176   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,180   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,185   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,189   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,195   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,200   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,205   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,211   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,217   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,223   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,230   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-04-24T00:53:20,281   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-04-24T00:53:20,284   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-04-24T00:53:20,289   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-04-24T00:53:20,293   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-04-24T00:53:20,299   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-04-24T00:53:20,304   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-04-24T00:53:20,309   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,315   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,323   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-04-24T00:53:20,325   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-04-24T00:53:20,329   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-04-24T00:53:20,336   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-04-24T00:53:20,339   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,346   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-04-24T00:53:20,348   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-04-24T00:53:20,351   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-04-24T00:53:20,355   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,359   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,364   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,369   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,374   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-04-24T00:53:20,375   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-04-24T00:53:20,380   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:20,382   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:20,387   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:20,393   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:20,396   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-04-24T00:53:20,402   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-04-24T00:53:20,407   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-04-24T00:53:20,411   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-04-24T00:53:20,417   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:20,419   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:20,423   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:20,427   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:20,431   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-04-24T00:53:20,434   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,438   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,445   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-04-24T00:53:20,447   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-04-24T00:53:20,452   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-04-24T00:53:20,457   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-04-24T00:53:20,462   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-04-24T00:53:20,466   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-04-24T00:53:20,474   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-04-24T00:53:20,481   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-04-24T00:53:20,484   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:20,487   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:20,492   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:20,497   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:20,501   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:20,506   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-04-24T00:53:20,512   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:20,514   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:20,521   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:20,527   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:20,531   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:20,538   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-04-24T00:53:20,542   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-04-24T00:53:20,547   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-04-24T00:53:20,552   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-04-24T00:53:20,557   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-04-24T00:53:20,562   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,568   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,582   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-04-24T00:53:20,588   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,590   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,595   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,599   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,603   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,609   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,614   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,619   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,624   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,628   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-04-24T00:53:20,632   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-04-24T00:53:20,637   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-04-24T00:53:20,639   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-04-24T00:53:20,644   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-04-24T00:53:20,649   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-04-24T00:53:20,654   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-04-24T00:53:20,658   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-04-24T00:53:20,663   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,666   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,671   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,676   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,681   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,685   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,690   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,695   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,701   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,706   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-04-24T00:53:20,712   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-04-24T00:53:20,714   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-04-24T00:53:20,718   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-04-24T00:53:20,721   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-04-24T00:53:20,725   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-04-24T00:53:20,728   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-04-24T00:53:20,732   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-04-24T00:53:20,736   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-04-24T00:53:20,741   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,744   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,750   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,755   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,759   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,764   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,769   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,774   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,779   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-04-24T00:53:20,784   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,786   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,790   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,795   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,798   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,802   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,806   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,810   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,814   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,817   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,823   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,827   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,832   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,839   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,841   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,846   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,852   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,856   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,861   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,865   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,870   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,874   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,879   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,885   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,889   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,894   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,899   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,903   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,907   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,913   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-04-24T00:53:20,915   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-04-24T00:53:20,921   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-04-24T00:53:20,925   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-04-24T00:53:20,930   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-04-24T00:53:20,934   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-04-24T00:53:20,938   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-04-24T00:53:20,943   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-04-24T00:53:20,948   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,953   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,957   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,962   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-04-24T00:53:20,967   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-04-24T00:53:20,973   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-04-24T00:53:20,975   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-04-24T00:53:20,981   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-04-24T00:53:20,983   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-04-24T00:53:20,988   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-04-24T00:53:20,994   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:20,996   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,002   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,006   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,010   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,015   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,019   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,024   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,028   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,032   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,036   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-04-24T00:53:21,041   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-04-24T00:53:21,043   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-04-24T00:53:21,048   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-04-24T00:53:21,052   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-04-24T00:53:21,057   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-04-24T00:53:21,058   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-04-24T00:53:21,062   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-04-24T00:53:21,066   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-04-24T00:53:21,070   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-04-24T00:53:21,074   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-04-24T00:53:21,079   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-04-24T00:53:21,084   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-04-24T00:53:21,087   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-04-24T00:53:21,089   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-04-24T00:53:21,093   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-04-24T00:53:21,097   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-04-24T00:53:21,101   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-04-24T00:53:21,105   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-04-24T00:53:21,109   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-04-24T00:53:21,114   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,116   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,121   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:21,123   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:21,127   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:21,130   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:21,134   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-04-24T00:53:21,139   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-04-24T00:53:21,141   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-04-24T00:53:21,145   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-04-24T00:53:21,148   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-04-24T00:53:21,153   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-04-24T00:53:21,157   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-04-24T00:53:21,161   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-04-24T00:53:21,167   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-04-24T00:53:21,168   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-04-24T00:53:21,172   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-04-24T00:53:21,177   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-04-24T00:53:21,179   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-04-24T00:53:21,182   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-04-24T00:53:21,186   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,190   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,193   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,198   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-04-24T00:53:21,199   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-04-24T00:53:21,204   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-04-24T00:53:21,207   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:21,209   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:21,213   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:21,216   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:21,220   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-04-24T00:53:21,224   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:21,226   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:21,230   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:21,233   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:21,237   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:21,240   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:21,244   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-04-24T00:53:21,248   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-04-24T00:53:21,252   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:21,254   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:21,258   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:21,261   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:21,265   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:21,269   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:21,272   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-04-24T00:53:21,277   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,279   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,283   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,288   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,291   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,295   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,299   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,302   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,307   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-04-24T00:53:21,310   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-04-24T00:53:21,315   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:21,317   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:21,321   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:21,324   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:21,328   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:21,331   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:21,335   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-04-24T00:53:21,341   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-04-24T00:53:21,342   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-04-24T00:53:21,346   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-04-24T00:53:21,350   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-04-24T00:53:21,354   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:21,356   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:21,360   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:21,363   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:21,367   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:21,370   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:21,374   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-04-24T00:53:21,379   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:21,381   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:21,384   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:21,389   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:21,393   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:21,396   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:21,400   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-04-24T00:53:21,405   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:21,407   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:21,411   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:21,415   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:21,420   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:21,424   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:21,429   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-04-24T00:53:21,434   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-04-24T00:53:21,435   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-04-24T00:53:21,439   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-04-24T00:53:21,444   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-04-24T00:53:21,447   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,449   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,453   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,457   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,461   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,465   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,470   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,475   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,478   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-04-24T00:53:21,484   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:21,486   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:21,490   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:21,493   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:21,498   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:21,502   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:21,505   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:21,509   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-04-24T00:53:21,513   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:21,515   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:21,520   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:21,523   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:21,527   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:21,530   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-04-24T00:53:21,534   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-04-24T00:53:21,537   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-04-24T00:53:21,542   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:21,543   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:21,548   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:21,551   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:21,554   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:21,558   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-04-24T00:53:21,563   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:21,565   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:21,569   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:21,574   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:21,577   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:21,582   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,584   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,588   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,591   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,595   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,599   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,603   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,608   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,611   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,615   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-04-24T00:53:21,619   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:21,623   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-04-24T00:53:21,628   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:21,630   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:21,634   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:21,638   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:21,641   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-04-24T00:53:21,647   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:21,648   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:21,652   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:21,658   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:21,663   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:21,668   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-04-24T00:53:21,672   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-04-24T00:53:21,674   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-04-24T00:53:21,678   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-04-24T00:53:21,682   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-04-24T00:53:21,684   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-04-24T00:53:21,688   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:21,690   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:21,694   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:21,698   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:21,702   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:21,705   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:21,709   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-04-24T00:53:21,714   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:21,715   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:21,720   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:21,723   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:21,727   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:21,730   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-04-24T00:53:21,735   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-04-24T00:53:21,737   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-04-24T00:53:21,741   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-04-24T00:53:21,744   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-04-24T00:53:21,746   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-04-24T00:53:21,750   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-04-24T00:53:21,755   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-04-24T00:53:21,757   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-04-24T00:53:21,766   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-04-24T00:53:21,769   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-04-24T00:53:21,773   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-04-24T00:53:21,775   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-04-24T00:53:21,779   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-04-24T00:53:21,783   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-04-24T00:53:21,785   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-04-24T00:53:21,789   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-04-24T00:53:21,792   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-04-24T00:53:21,797   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-04-24T00:53:21,799   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-04-24T00:53:21,803   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-04-24T00:53:21,808   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-04-24T00:53:21,810   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-04-24T00:53:21,813   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-04-24T00:53:21,818   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-04-24T00:53:21,820   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-04-24T00:53:21,824   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-04-24T00:53:21,828   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-04-24T00:53:21,832   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-04-24T00:53:21,836   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:21,838   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:21,841   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:21,845   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:21,849   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:21,852   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:21,856   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:21,860   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-04-24T00:53:21,863   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-04-24T00:53:21,869   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,870   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,874   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,878   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,881   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,885   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,889   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,892   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,896   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-04-24T00:53:21,900   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-04-24T00:53:21,903   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,907   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,912   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,916   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:21,921   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:21,923   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:21,925   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:21,929   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:21,933   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:21,937   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-04-24T00:53:21,940   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:21,946   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:21,948   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:21,952   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:21,956   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:21,960   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-04-24T00:53:21,964   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:21,970   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:21,971   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:21,975   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:21,978   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:21,983   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-04-24T00:53:21,988   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:21,993   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:21,996   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,001   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,005   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,009   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,013   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,017   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,022   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,025   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,030   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-04-24T00:53:22,034   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:22,040   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,042   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,047   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,052   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,057   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,061   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,066   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,071   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,074   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,078   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-04-24T00:53:22,082   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:22,088   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:22,090   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:22,094   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:22,097   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:22,102   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-04-24T00:53:22,107   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:22,109   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:22,112   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:22,116   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:22,120   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-04-24T00:53:22,125   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:22,127   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:22,131   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:22,134   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:22,139   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-04-24T00:53:22,144   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:22,145   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:22,150   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:22,153   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:22,158   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-04-24T00:53:22,161   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:22,167   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-04-24T00:53:22,173   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:22,174   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:22,179   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:22,182   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:22,186   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-04-24T00:53:22,190   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-04-24T00:53:22,193   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-04-24T00:53:22,198   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-04-24T00:53:22,205   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-04-24T00:53:22,207   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-04-24T00:53:22,211   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-04-24T00:53:22,215   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-04-24T00:53:22,217   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-04-24T00:53:22,221   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-04-24T00:53:22,228   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-04-24T00:53:22,232   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-04-24T00:53:22,234   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-04-24T00:53:22,238   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-04-24T00:53:22,241   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-04-24T00:53:22,246   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-04-24T00:53:22,248   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-04-24T00:53:22,252   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-04-24T00:53:22,256   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-04-24T00:53:22,260   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-04-24T00:53:22,265   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-04-24T00:53:22,273   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-04-24T00:53:22,275   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-04-24T00:53:22,279   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-04-24T00:53:22,282   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-04-24T00:53:22,286   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-04-24T00:53:22,290   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-04-24T00:53:22,294   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-04-24T00:53:22,298   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-04-24T00:53:22,303   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-04-24T00:53:22,305   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-04-24T00:53:22,308   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-04-24T00:53:22,311   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-04-24T00:53:22,315   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-04-24T00:53:22,319   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,321   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,325   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,329   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,332   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,337   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,341   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,345   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,349   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,352   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,356   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,360   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,365   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,369   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,373   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,377   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,380   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,385   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-04-24T00:53:22,389   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-04-24T00:53:22,391   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-04-24T00:53:22,394   running install_egg_info
2024-04-24T00:53:22,464   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.14.2-py3.7.egg-info
2024-04-24T00:53:22,493   running install_scripts
2024-04-24T00:53:22,496   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data
2024-04-24T00:53:22,497   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,499   copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,503   copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,507   copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,510   copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,514   copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,518   copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,521   copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,524   copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts
2024-04-24T00:53:22,527   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts/ds_elastic to 755
2024-04-24T00:53:22,528   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts/ds_bench to 755
2024-04-24T00:53:22,529   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts/deepspeed to 755
2024-04-24T00:53:22,530   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts/deepspeed.pt to 755
2024-04-24T00:53:22,530   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts/dsr to 755
2024-04-24T00:53:22,531   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts/ds to 755
2024-04-24T00:53:22,532   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts/ds_report to 755
2024-04-24T00:53:22,532   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.data/scripts/ds_ssh to 755
2024-04-24T00:53:22,715   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.2.dist-info/WHEEL
2024-04-24T00:53:22,720   creating '/tmp/pip-wheel-f3s017r0/deepspeed-0.14.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-04-24T00:53:22,728   adding 'deepspeed/__init__.py'
2024-04-24T00:53:22,731   adding 'deepspeed/constants.py'
2024-04-24T00:53:22,735   adding 'deepspeed/env_report.py'
2024-04-24T00:53:22,738   adding 'deepspeed/git_version_info.py'
2024-04-24T00:53:22,740   adding 'deepspeed/git_version_info_installed.py'
2024-04-24T00:53:22,743   adding 'deepspeed/pydantic_v1.py'
2024-04-24T00:53:22,747   adding 'deepspeed/accelerator/__init__.py'
2024-04-24T00:53:22,750   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-04-24T00:53:22,753   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-04-24T00:53:22,758   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-04-24T00:53:22,762   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-04-24T00:53:22,766   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-04-24T00:53:22,770   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-04-24T00:53:22,773   adding 'deepspeed/accelerator/real_accelerator.py'
2024-04-24T00:53:22,777   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-04-24T00:53:22,781   adding 'deepspeed/autotuning/__init__.py'
2024-04-24T00:53:22,794   adding 'deepspeed/autotuning/autotuner.py'
2024-04-24T00:53:22,798   adding 'deepspeed/autotuning/config.py'
2024-04-24T00:53:22,801   adding 'deepspeed/autotuning/constants.py'
2024-04-24T00:53:22,807   adding 'deepspeed/autotuning/scheduler.py'
2024-04-24T00:53:22,812   adding 'deepspeed/autotuning/utils.py'
2024-04-24T00:53:22,816   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-04-24T00:53:22,818   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-04-24T00:53:22,821   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-04-24T00:53:22,823   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-04-24T00:53:22,827   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-04-24T00:53:22,830   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-04-24T00:53:22,832   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-04-24T00:53:22,835   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-04-24T00:53:22,838   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-04-24T00:53:22,841   adding 'deepspeed/autotuning/tuner/utils.py'
2024-04-24T00:53:22,844   adding 'deepspeed/checkpoint/__init__.py'
2024-04-24T00:53:22,848   adding 'deepspeed/checkpoint/constants.py'
2024-04-24T00:53:22,852   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-04-24T00:53:22,858   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-04-24T00:53:22,861   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-04-24T00:53:22,865   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-04-24T00:53:22,868   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-04-24T00:53:22,871   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-04-24T00:53:22,874   adding 'deepspeed/checkpoint/utils.py'
2024-04-24T00:53:22,877   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-04-24T00:53:22,881   adding 'deepspeed/comm/__init__.py'
2024-04-24T00:53:22,883   adding 'deepspeed/comm/backend.py'
2024-04-24T00:53:22,887   adding 'deepspeed/comm/ccl.py'
2024-04-24T00:53:22,894   adding 'deepspeed/comm/comm.py'
2024-04-24T00:53:22,898   adding 'deepspeed/comm/config.py'
2024-04-24T00:53:22,900   adding 'deepspeed/comm/constants.py'
2024-04-24T00:53:22,903   adding 'deepspeed/comm/reduce_op.py'
2024-04-24T00:53:22,907   adding 'deepspeed/comm/torch.py'
2024-04-24T00:53:22,911   adding 'deepspeed/comm/utils.py'
2024-04-24T00:53:22,914   adding 'deepspeed/compression/__init__.py'
2024-04-24T00:53:22,922   adding 'deepspeed/compression/basic_layer.py'
2024-04-24T00:53:22,927   adding 'deepspeed/compression/compress.py'
2024-04-24T00:53:22,932   adding 'deepspeed/compression/config.py'
2024-04-24T00:53:22,935   adding 'deepspeed/compression/constants.py'
2024-04-24T00:53:22,940   adding 'deepspeed/compression/helper.py'
2024-04-24T00:53:22,943   adding 'deepspeed/compression/scheduler.py'
2024-04-24T00:53:22,947   adding 'deepspeed/compression/utils.py'
2024-04-24T00:53:22,950   adding 'deepspeed/elasticity/__init__.py'
2024-04-24T00:53:22,953   adding 'deepspeed/elasticity/config.py'
2024-04-24T00:53:22,956   adding 'deepspeed/elasticity/constants.py'
2024-04-24T00:53:22,960   adding 'deepspeed/elasticity/elastic_agent.py'
2024-04-24T00:53:22,965   adding 'deepspeed/elasticity/elasticity.py'
2024-04-24T00:53:22,968   adding 'deepspeed/elasticity/utils.py'
2024-04-24T00:53:22,971   adding 'deepspeed/inference/__init__.py'
2024-04-24T00:53:22,975   adding 'deepspeed/inference/config.py'
2024-04-24T00:53:22,984   adding 'deepspeed/inference/engine.py'
2024-04-24T00:53:22,988   adding 'deepspeed/inference/quantization/__init__.py'
2024-04-24T00:53:22,991   adding 'deepspeed/inference/quantization/layers.py'
2024-04-24T00:53:22,994   adding 'deepspeed/inference/quantization/quantization.py'
2024-04-24T00:53:22,997   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-04-24T00:53:23,001   adding 'deepspeed/inference/quantization/utils.py'
2024-04-24T00:53:23,005   adding 'deepspeed/inference/v2/__init__.py'
2024-04-24T00:53:23,008   adding 'deepspeed/inference/v2/allocator.py'
2024-04-24T00:53:23,010   adding 'deepspeed/inference/v2/config_v2.py'
2024-04-24T00:53:23,013   adding 'deepspeed/inference/v2/engine_factory.py'
2024-04-24T00:53:23,018   adding 'deepspeed/inference/v2/engine_v2.py'
2024-04-24T00:53:23,020   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-04-24T00:53:23,023   adding 'deepspeed/inference/v2/inference_utils.py'
2024-04-24T00:53:23,026   adding 'deepspeed/inference/v2/logging.py'
2024-04-24T00:53:23,029   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-04-24T00:53:23,032   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-04-24T00:53:23,035   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-04-24T00:53:23,038   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-04-24T00:53:23,041   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-04-24T00:53:23,044   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-04-24T00:53:23,047   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-04-24T00:53:23,050   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-04-24T00:53:23,053   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-04-24T00:53:23,057   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-04-24T00:53:23,059   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-04-24T00:53:23,062   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-04-24T00:53:23,065   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-04-24T00:53:23,068   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-04-24T00:53:23,071   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-04-24T00:53:23,074   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-04-24T00:53:23,077   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-04-24T00:53:23,081   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-04-24T00:53:23,084   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-04-24T00:53:23,087   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-04-24T00:53:23,090   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-04-24T00:53:23,092   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-04-24T00:53:23,095   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-04-24T00:53:23,097   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-04-24T00:53:23,100   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-04-24T00:53:23,104   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-04-24T00:53:23,109   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-04-24T00:53:23,112   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-04-24T00:53:23,116   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-04-24T00:53:23,119   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-04-24T00:53:23,123   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-04-24T00:53:23,126   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-04-24T00:53:23,130   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-04-24T00:53:23,134   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-04-24T00:53:23,138   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-04-24T00:53:23,140   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-04-24T00:53:23,143   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-04-24T00:53:23,147   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-04-24T00:53:23,151   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-04-24T00:53:23,154   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-04-24T00:53:23,157   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-04-24T00:53:23,161   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-04-24T00:53:23,164   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-04-24T00:53:23,167   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-04-24T00:53:23,169   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-04-24T00:53:23,171   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-04-24T00:53:23,175   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-04-24T00:53:23,178   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-04-24T00:53:23,181   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-04-24T00:53:23,184   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-04-24T00:53:23,187   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-04-24T00:53:23,190   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-04-24T00:53:23,193   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-04-24T00:53:23,197   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-04-24T00:53:23,199   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-04-24T00:53:23,203   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-04-24T00:53:23,206   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-04-24T00:53:23,208   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-04-24T00:53:23,211   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-04-24T00:53:23,213   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-04-24T00:53:23,217   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-04-24T00:53:23,220   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-04-24T00:53:23,223   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-04-24T00:53:23,226   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-04-24T00:53:23,229   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-04-24T00:53:23,231   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-04-24T00:53:23,235   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-04-24T00:53:23,238   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-04-24T00:53:23,242   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-04-24T00:53:23,244   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-04-24T00:53:23,250   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-04-24T00:53:23,257   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-04-24T00:53:23,261   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-04-24T00:53:23,263   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-04-24T00:53:23,267   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-04-24T00:53:23,269   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-04-24T00:53:23,272   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-04-24T00:53:23,274   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-04-24T00:53:23,278   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-04-24T00:53:23,281   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-04-24T00:53:23,284   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-04-24T00:53:23,286   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-04-24T00:53:23,289   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-04-24T00:53:23,292   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-04-24T00:53:23,295   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-04-24T00:53:23,298   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-04-24T00:53:23,301   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-04-24T00:53:23,303   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-04-24T00:53:23,306   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-04-24T00:53:23,310   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-04-24T00:53:23,313   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-04-24T00:53:23,317   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-04-24T00:53:23,320   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-04-24T00:53:23,323   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-04-24T00:53:23,325   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-04-24T00:53:23,328   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-04-24T00:53:23,333   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-04-24T00:53:23,336   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-04-24T00:53:23,339   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-04-24T00:53:23,342   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-04-24T00:53:23,345   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-04-24T00:53:23,347   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-04-24T00:53:23,350   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-04-24T00:53:23,353   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-04-24T00:53:23,355   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-04-24T00:53:23,359   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-04-24T00:53:23,362   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-04-24T00:53:23,364   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-04-24T00:53:23,367   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-04-24T00:53:23,370   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-04-24T00:53:23,373   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-04-24T00:53:23,377   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-04-24T00:53:23,379   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-04-24T00:53:23,382   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-04-24T00:53:23,384   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-04-24T00:53:23,387   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-04-24T00:53:23,391   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-04-24T00:53:23,394   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-04-24T00:53:23,397   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-04-24T00:53:23,400   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-04-24T00:53:23,403   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-04-24T00:53:23,406   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-04-24T00:53:23,408   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-04-24T00:53:23,411   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-04-24T00:53:23,413   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-04-24T00:53:23,417   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-04-24T00:53:23,421   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-04-24T00:53:23,424   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-04-24T00:53:23,429   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-04-24T00:53:23,433   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-04-24T00:53:23,439   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-04-24T00:53:23,444   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-04-24T00:53:23,448   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-04-24T00:53:23,452   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-04-24T00:53:23,455   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-04-24T00:53:23,457   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-04-24T00:53:23,460   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-04-24T00:53:23,463   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-04-24T00:53:23,465   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-04-24T00:53:23,468   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-04-24T00:53:23,471   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-04-24T00:53:23,473   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-04-24T00:53:23,477   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-04-24T00:53:23,480   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-04-24T00:53:23,483   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-04-24T00:53:23,486   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-04-24T00:53:23,489   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-04-24T00:53:23,492   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-04-24T00:53:23,496   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-04-24T00:53:23,499   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-04-24T00:53:23,502   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-04-24T00:53:23,505   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-04-24T00:53:23,508   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-04-24T00:53:23,511   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-04-24T00:53:23,514   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-04-24T00:53:23,517   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-04-24T00:53:23,521   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-04-24T00:53:23,524   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-04-24T00:53:23,527   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-04-24T00:53:23,530   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-04-24T00:53:23,533   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-04-24T00:53:23,536   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-04-24T00:53:23,540   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-04-24T00:53:23,542   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-04-24T00:53:23,546   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-04-24T00:53:23,549   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-04-24T00:53:23,552   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-04-24T00:53:23,555   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-04-24T00:53:23,559   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-04-24T00:53:23,561   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-04-24T00:53:23,565   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-04-24T00:53:23,568   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-04-24T00:53:23,571   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-04-24T00:53:23,574   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-04-24T00:53:23,578   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-04-24T00:53:23,580   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-04-24T00:53:23,583   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-04-24T00:53:23,586   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-04-24T00:53:23,589   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-04-24T00:53:23,592   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-04-24T00:53:23,595   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-04-24T00:53:23,598   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-04-24T00:53:23,601   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-04-24T00:53:23,604   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-04-24T00:53:23,607   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-04-24T00:53:23,610   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-04-24T00:53:23,613   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-04-24T00:53:23,617   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-04-24T00:53:23,620   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-04-24T00:53:23,622   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-04-24T00:53:23,625   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-04-24T00:53:23,628   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-04-24T00:53:23,630   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-04-24T00:53:23,633   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-04-24T00:53:23,636   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-04-24T00:53:23,640   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-04-24T00:53:23,643   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-04-24T00:53:23,653   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-04-24T00:53:23,657   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-04-24T00:53:23,660   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-04-24T00:53:23,664   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-04-24T00:53:23,668   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-04-24T00:53:23,671   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-04-24T00:53:23,675   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-04-24T00:53:23,679   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-04-24T00:53:23,681   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-04-24T00:53:23,685   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-04-24T00:53:23,687   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-04-24T00:53:23,690   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-04-24T00:53:23,694   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-04-24T00:53:23,697   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-04-24T00:53:23,701   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-04-24T00:53:23,704   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-04-24T00:53:23,707   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-04-24T00:53:23,710   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-04-24T00:53:23,713   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-04-24T00:53:23,715   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-04-24T00:53:23,718   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-04-24T00:53:23,721   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-04-24T00:53:23,725   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-04-24T00:53:23,728   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-04-24T00:53:23,732   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-04-24T00:53:23,735   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-04-24T00:53:23,739   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-04-24T00:53:23,743   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-04-24T00:53:23,747   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-04-24T00:53:23,751   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-04-24T00:53:23,754   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-04-24T00:53:23,758   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-04-24T00:53:23,761   adding 'deepspeed/launcher/__init__.py'
2024-04-24T00:53:23,764   adding 'deepspeed/launcher/constants.py'
2024-04-24T00:53:23,769   adding 'deepspeed/launcher/launch.py'
2024-04-24T00:53:23,772   adding 'deepspeed/launcher/launcher_helper.py'
2024-04-24T00:53:23,782   adding 'deepspeed/launcher/multinode_runner.py'
2024-04-24T00:53:23,790   adding 'deepspeed/launcher/runner.py'
2024-04-24T00:53:23,793   adding 'deepspeed/linear/__init__.py'
2024-04-24T00:53:23,796   adding 'deepspeed/linear/config.py'
2024-04-24T00:53:23,799   adding 'deepspeed/linear/optimized_linear.py'
2024-04-24T00:53:23,803   adding 'deepspeed/linear/quantization.py'
2024-04-24T00:53:23,807   adding 'deepspeed/model_implementations/__init__.py'
2024-04-24T00:53:23,810   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-04-24T00:53:23,813   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-04-24T00:53:23,816   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-04-24T00:53:23,819   adding 'deepspeed/model_implementations/features/__init__.py'
2024-04-24T00:53:23,822   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-04-24T00:53:23,826   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-04-24T00:53:23,829   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-04-24T00:53:23,831   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-04-24T00:53:23,834   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-04-24T00:53:23,836   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-04-24T00:53:23,839   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-04-24T00:53:23,841   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-04-24T00:53:23,844   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-04-24T00:53:23,846   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-04-24T00:53:23,850   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-04-24T00:53:23,854   adding 'deepspeed/module_inject/__init__.py'
2024-04-24T00:53:23,861   adding 'deepspeed/module_inject/auto_tp.py'
2024-04-24T00:53:23,864   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-04-24T00:53:23,868   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-04-24T00:53:23,871   adding 'deepspeed/module_inject/inject.py'
2024-04-24T00:53:23,875   adding 'deepspeed/module_inject/layers.py'
2024-04-24T00:53:23,879   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-04-24T00:53:23,882   adding 'deepspeed/module_inject/module_quantize.py'
2024-04-24T00:53:23,886   adding 'deepspeed/module_inject/policy.py'
2024-04-24T00:53:23,895   adding 'deepspeed/module_inject/replace_module.py'
2024-04-24T00:53:23,898   adding 'deepspeed/module_inject/replace_policy.py'
2024-04-24T00:53:23,900   adding 'deepspeed/module_inject/tp_shard.py'
2024-04-24T00:53:23,903   adding 'deepspeed/module_inject/utils.py'
2024-04-24T00:53:23,907   adding 'deepspeed/module_inject/containers/__init__.py'
2024-04-24T00:53:23,912   adding 'deepspeed/module_inject/containers/base.py'
2024-04-24T00:53:23,915   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-04-24T00:53:23,919   adding 'deepspeed/module_inject/containers/bert.py'
2024-04-24T00:53:23,922   adding 'deepspeed/module_inject/containers/bloom.py'
2024-04-24T00:53:23,925   adding 'deepspeed/module_inject/containers/clip.py'
2024-04-24T00:53:23,928   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-04-24T00:53:23,930   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-04-24T00:53:23,933   adding 'deepspeed/module_inject/containers/gptj.py'
2024-04-24T00:53:23,937   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-04-24T00:53:23,940   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-04-24T00:53:23,943   adding 'deepspeed/module_inject/containers/internlm.py'
2024-04-24T00:53:23,947   adding 'deepspeed/module_inject/containers/llama.py'
2024-04-24T00:53:23,950   adding 'deepspeed/module_inject/containers/llama2.py'
2024-04-24T00:53:23,953   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-04-24T00:53:23,956   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-04-24T00:53:23,960   adding 'deepspeed/module_inject/containers/opt.py'
2024-04-24T00:53:23,962   adding 'deepspeed/module_inject/containers/unet.py'
2024-04-24T00:53:23,965   adding 'deepspeed/module_inject/containers/vae.py'
2024-04-24T00:53:23,968   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-04-24T00:53:23,971   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-04-24T00:53:23,975   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-04-24T00:53:23,979   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-04-24T00:53:23,981   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-04-24T00:53:23,984   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-04-24T00:53:23,987   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-04-24T00:53:23,991   adding 'deepspeed/moe/__init__.py'
2024-04-24T00:53:23,993   adding 'deepspeed/moe/experts.py'
2024-04-24T00:53:23,997   adding 'deepspeed/moe/layer.py'
2024-04-24T00:53:24,000   adding 'deepspeed/moe/mappings.py'
2024-04-24T00:53:24,007   adding 'deepspeed/moe/sharded_moe.py'
2024-04-24T00:53:24,011   adding 'deepspeed/moe/utils.py'
2024-04-24T00:53:24,014   adding 'deepspeed/monitor/__init__.py'
2024-04-24T00:53:24,017   adding 'deepspeed/monitor/config.py'
2024-04-24T00:53:24,020   adding 'deepspeed/monitor/csv_monitor.py'
2024-04-24T00:53:24,023   adding 'deepspeed/monitor/monitor.py'
2024-04-24T00:53:24,025   adding 'deepspeed/monitor/tensorboard.py'
2024-04-24T00:53:24,028   adding 'deepspeed/monitor/utils.py'
2024-04-24T00:53:24,031   adding 'deepspeed/monitor/wandb.py'
2024-04-24T00:53:24,034   adding 'deepspeed/nebula/__init__.py'
2024-04-24T00:53:24,036   adding 'deepspeed/nebula/config.py'
2024-04-24T00:53:24,039   adding 'deepspeed/nebula/constants.py'
2024-04-24T00:53:24,043   adding 'deepspeed/ops/__init__.py'
2024-04-24T00:53:24,047   adding 'deepspeed/ops/adagrad/__init__.py'
2024-04-24T00:53:24,050   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-04-24T00:53:24,054   adding 'deepspeed/ops/adam/__init__.py'
2024-04-24T00:53:24,057   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-04-24T00:53:24,061   adding 'deepspeed/ops/adam/fused_adam.py'
2024-04-24T00:53:24,064   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-04-24T00:53:24,068   adding 'deepspeed/ops/aio/__init__.py'
2024-04-24T00:53:24,074   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-04-24T00:53:24,078   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-04-24T00:53:24,081   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-04-24T00:53:24,084   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-04-24T00:53:24,087   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-04-24T00:53:24,091   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-04-24T00:53:24,097   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-04-24T00:53:24,100   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-04-24T00:53:24,103   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-04-24T00:53:24,105   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-04-24T00:53:24,109   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-04-24T00:53:24,111   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-04-24T00:53:24,116   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-04-24T00:53:24,119   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-04-24T00:53:24,121   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-04-24T00:53:24,124   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-04-24T00:53:24,127   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-04-24T00:53:24,129   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-04-24T00:53:24,133   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-04-24T00:53:24,136   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-04-24T00:53:24,139   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-04-24T00:53:24,141   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-04-24T00:53:24,144   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-04-24T00:53:24,148   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-04-24T00:53:24,151   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2024-04-24T00:53:24,156   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-04-24T00:53:24,162   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-04-24T00:53:24,168   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-04-24T00:53:24,171   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-04-24T00:53:24,174   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-04-24T00:53:24,178   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-04-24T00:53:24,183   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-04-24T00:53:24,186   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-04-24T00:53:24,190   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-04-24T00:53:24,194   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-04-24T00:53:24,214   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-04-24T00:53:24,227   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-04-24T00:53:24,233   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-04-24T00:53:24,239   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-04-24T00:53:24,244   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-04-24T00:53:24,247   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-04-24T00:53:24,252   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-04-24T00:53:24,255   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-04-24T00:53:24,262   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-04-24T00:53:24,268   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-04-24T00:53:24,272   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-04-24T00:53:24,276   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-04-24T00:53:24,295   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-04-24T00:53:24,304   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-04-24T00:53:24,308   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-04-24T00:53:24,318   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-04-24T00:53:24,327   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-04-24T00:53:24,338   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-04-24T00:53:24,342   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-04-24T00:53:24,347   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-04-24T00:53:24,351   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-04-24T00:53:24,354   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-04-24T00:53:24,358   adding 'deepspeed/ops/csrc/fp_quantizer/quantize.cpp'
2024-04-24T00:53:24,364   adding 'deepspeed/ops/csrc/fp_quantizer/quantize.cu'
2024-04-24T00:53:24,368   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-04-24T00:53:24,371   adding 'deepspeed/ops/csrc/fp_quantizer/includes/quantize.h'
2024-04-24T00:53:24,376   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-04-24T00:53:24,379   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-04-24T00:53:24,381   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-04-24T00:53:24,383   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-04-24T00:53:24,387   adding 'deepspeed/ops/csrc/includes/context.h'
2024-04-24T00:53:24,391   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-04-24T00:53:24,394   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-04-24T00:53:24,398   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-04-24T00:53:24,402   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-04-24T00:53:24,405   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-04-24T00:53:24,409   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-04-24T00:53:24,413   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-04-24T00:53:24,415   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-04-24T00:53:24,418   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-04-24T00:53:24,421   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-04-24T00:53:24,424   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-04-24T00:53:24,427   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-04-24T00:53:24,430   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-04-24T00:53:24,433   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-04-24T00:53:24,439   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-04-24T00:53:24,443   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-04-24T00:53:24,445   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-04-24T00:53:24,450   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-04-24T00:53:24,453   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-04-24T00:53:24,459   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-04-24T00:53:24,463   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-04-24T00:53:24,465   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-04-24T00:53:24,468   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-04-24T00:53:24,472   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-04-24T00:53:24,475   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-04-24T00:53:24,480   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-04-24T00:53:24,484   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-04-24T00:53:24,487   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-04-24T00:53:24,490   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-04-24T00:53:24,493   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-04-24T00:53:24,496   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-04-24T00:53:24,501   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-04-24T00:53:24,507   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-04-24T00:53:24,512   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-04-24T00:53:24,516   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-04-24T00:53:24,519   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-04-24T00:53:24,523   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-04-24T00:53:24,526   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-04-24T00:53:24,531   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-04-24T00:53:24,534   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-04-24T00:53:24,537   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-04-24T00:53:24,541   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-04-24T00:53:24,545   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-04-24T00:53:24,550   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-04-24T00:53:24,553   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-04-24T00:53:24,556   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-04-24T00:53:24,562   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-04-24T00:53:24,568   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-04-24T00:53:24,578   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-04-24T00:53:24,583   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-04-24T00:53:24,587   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-04-24T00:53:24,598   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-04-24T00:53:24,606   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-04-24T00:53:24,612   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-04-24T00:53:24,619   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-04-24T00:53:24,622   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-04-24T00:53:24,629   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-04-24T00:53:24,634   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-04-24T00:53:24,638   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-04-24T00:53:24,652   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-04-24T00:53:24,657   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-04-24T00:53:24,661   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-04-24T00:53:24,667   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-04-24T00:53:24,674   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-04-24T00:53:24,680   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-04-24T00:53:24,684   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-04-24T00:53:24,688   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-04-24T00:53:24,691   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-04-24T00:53:24,697   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-04-24T00:53:24,700   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp'
2024-04-24T00:53:24,704   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp'
2024-04-24T00:53:24,706   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-04-24T00:53:24,710   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-04-24T00:53:24,714   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-04-24T00:53:24,717   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-04-24T00:53:24,720   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-04-24T00:53:24,724   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-04-24T00:53:24,727   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-04-24T00:53:24,730   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-04-24T00:53:24,734   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-04-24T00:53:24,737   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-04-24T00:53:24,740   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-04-24T00:53:24,743   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-04-24T00:53:24,747   adding 'deepspeed/ops/lamb/__init__.py'
2024-04-24T00:53:24,750   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-04-24T00:53:24,754   adding 'deepspeed/ops/lion/__init__.py'
2024-04-24T00:53:24,757   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-04-24T00:53:24,761   adding 'deepspeed/ops/lion/fused_lion.py'
2024-04-24T00:53:24,763   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-04-24T00:53:24,768   adding 'deepspeed/ops/op_builder/__init__.py'
2024-04-24T00:53:24,770   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-04-24T00:53:24,773   adding 'deepspeed/ops/op_builder/async_io.py'
2024-04-24T00:53:24,782   adding 'deepspeed/ops/op_builder/builder.py'
2024-04-24T00:53:24,785   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-04-24T00:53:24,788   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-04-24T00:53:24,791   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-04-24T00:53:24,793   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-04-24T00:53:24,796   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-04-24T00:53:24,799   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-04-24T00:53:24,801   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-04-24T00:53:24,804   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-04-24T00:53:24,807   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-04-24T00:53:24,810   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-04-24T00:53:24,812   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-04-24T00:53:24,815   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-04-24T00:53:24,818   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-04-24T00:53:24,820   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-04-24T00:53:24,823   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-04-24T00:53:24,826   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-04-24T00:53:24,828   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-04-24T00:53:24,831   adding 'deepspeed/ops/op_builder/transformer.py'
2024-04-24T00:53:24,833   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-04-24T00:53:24,837   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-04-24T00:53:24,839   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-04-24T00:53:24,842   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-04-24T00:53:24,844   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-04-24T00:53:24,847   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-04-24T00:53:24,850   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-04-24T00:53:24,853   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-04-24T00:53:24,856   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-04-24T00:53:24,858   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-04-24T00:53:24,861   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-04-24T00:53:24,863   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-04-24T00:53:24,867   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-04-24T00:53:24,870   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-04-24T00:53:24,873   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-04-24T00:53:24,876   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-04-24T00:53:24,878   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-04-24T00:53:24,881   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-04-24T00:53:24,883   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-04-24T00:53:24,887   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-04-24T00:53:24,890   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-04-24T00:53:24,894   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-04-24T00:53:24,897   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-04-24T00:53:24,900   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-04-24T00:53:24,903   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-04-24T00:53:24,905   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-04-24T00:53:24,908   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-04-24T00:53:24,911   adding 'deepspeed/ops/quantizer/__init__.py'
2024-04-24T00:53:24,914   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-04-24T00:53:24,917   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-04-24T00:53:24,921   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-04-24T00:53:24,924   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-04-24T00:53:24,927   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-04-24T00:53:24,937   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-04-24T00:53:24,942   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-04-24T00:53:24,946   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-04-24T00:53:24,950   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-04-24T00:53:24,957   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-04-24T00:53:24,962   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-04-24T00:53:24,965   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-04-24T00:53:24,968   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-04-24T00:53:24,971   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-04-24T00:53:24,975   adding 'deepspeed/ops/transformer/__init__.py'
2024-04-24T00:53:24,980   adding 'deepspeed/ops/transformer/transformer.py'
2024-04-24T00:53:24,985   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-04-24T00:53:24,988   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-04-24T00:53:24,991   adding 'deepspeed/ops/transformer/inference/config.py'
2024-04-24T00:53:24,993   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-04-24T00:53:24,997   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-04-24T00:53:25,000   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-04-24T00:53:25,005   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-04-24T00:53:25,009   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-04-24T00:53:25,015   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-04-24T00:53:25,018   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-04-24T00:53:25,022   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-04-24T00:53:25,025   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-04-24T00:53:25,028   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-04-24T00:53:25,031   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-04-24T00:53:25,033   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-04-24T00:53:25,036   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-04-24T00:53:25,039   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-04-24T00:53:25,042   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-04-24T00:53:25,045   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-04-24T00:53:25,048   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-04-24T00:53:25,052   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-04-24T00:53:25,057   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-04-24T00:53:25,060   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-04-24T00:53:25,063   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-04-24T00:53:25,068   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-04-24T00:53:25,071   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-04-24T00:53:25,074   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-04-24T00:53:25,077   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-04-24T00:53:25,080   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-04-24T00:53:25,084   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-04-24T00:53:25,088   adding 'deepspeed/pipe/__init__.py'
2024-04-24T00:53:25,092   adding 'deepspeed/profiling/__init__.py'
2024-04-24T00:53:25,094   adding 'deepspeed/profiling/config.py'
2024-04-24T00:53:25,097   adding 'deepspeed/profiling/constants.py'
2024-04-24T00:53:25,100   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-04-24T00:53:25,114   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-04-24T00:53:25,119   adding 'deepspeed/runtime/__init__.py'
2024-04-24T00:53:25,122   adding 'deepspeed/runtime/base_optimizer.py'
2024-04-24T00:53:25,129   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-04-24T00:53:25,133   adding 'deepspeed/runtime/compiler.py'
2024-04-24T00:53:25,143   adding 'deepspeed/runtime/config.py'
2024-04-24T00:53:25,148   adding 'deepspeed/runtime/config_utils.py'
2024-04-24T00:53:25,152   adding 'deepspeed/runtime/constants.py'
2024-04-24T00:53:25,155   adding 'deepspeed/runtime/dataloader.py'
2024-04-24T00:53:25,159   adding 'deepspeed/runtime/eigenvalue.py'
2024-04-24T00:53:25,204   adding 'deepspeed/runtime/engine.py'
2024-04-24T00:53:25,213   adding 'deepspeed/runtime/hybrid_engine.py'
2024-04-24T00:53:25,222   adding 'deepspeed/runtime/lr_schedules.py'
2024-04-24T00:53:25,225   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-04-24T00:53:25,229   adding 'deepspeed/runtime/quantize.py'
2024-04-24T00:53:25,232   adding 'deepspeed/runtime/sparse_tensor.py'
2024-04-24T00:53:25,237   adding 'deepspeed/runtime/state_dict_factory.py'
2024-04-24T00:53:25,249   adding 'deepspeed/runtime/utils.py'
2024-04-24T00:53:25,253   adding 'deepspeed/runtime/weight_quantizer.py'
2024-04-24T00:53:25,257   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-04-24T00:53:25,268   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-04-24T00:53:25,272   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-04-24T00:53:25,276   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-04-24T00:53:25,278   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-04-24T00:53:25,281   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-04-24T00:53:25,284   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-04-24T00:53:25,287   adding 'deepspeed/runtime/comm/__init__.py'
2024-04-24T00:53:25,291   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-04-24T00:53:25,294   adding 'deepspeed/runtime/comm/hccl.py'
2024-04-24T00:53:25,299   adding 'deepspeed/runtime/comm/mpi.py'
2024-04-24T00:53:25,302   adding 'deepspeed/runtime/comm/nccl.py'
2024-04-24T00:53:25,306   adding 'deepspeed/runtime/compression/__init__.py'
2024-04-24T00:53:25,308   adding 'deepspeed/runtime/compression/cupy.py'
2024-04-24T00:53:25,312   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-04-24T00:53:25,315   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-04-24T00:53:25,318   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-04-24T00:53:25,322   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-04-24T00:53:25,326   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-04-24T00:53:25,329   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-04-24T00:53:25,332   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-04-24T00:53:25,335   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-04-24T00:53:25,338   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-04-24T00:53:25,341   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-04-24T00:53:25,354   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-04-24T00:53:25,360   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-04-24T00:53:25,367   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-04-24T00:53:25,370   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-04-24T00:53:25,374   adding 'deepspeed/runtime/fp16/__init__.py'
2024-04-24T00:53:25,380   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-04-24T00:53:25,385   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-04-24T00:53:25,391   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-04-24T00:53:25,395   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-04-24T00:53:25,400   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-04-24T00:53:25,407   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-04-24T00:53:25,413   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-04-24T00:53:25,417   adding 'deepspeed/runtime/pipe/__init__.py'
2024-04-24T00:53:25,433   adding 'deepspeed/runtime/pipe/engine.py'
2024-04-24T00:53:25,443   adding 'deepspeed/runtime/pipe/module.py'
2024-04-24T00:53:25,447   adding 'deepspeed/runtime/pipe/p2p.py'
2024-04-24T00:53:25,452   adding 'deepspeed/runtime/pipe/schedule.py'
2024-04-24T00:53:25,458   adding 'deepspeed/runtime/pipe/topology.py'
2024-04-24T00:53:25,462   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-04-24T00:53:25,464   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-04-24T00:53:25,468   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-04-24T00:53:25,471   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-04-24T00:53:25,477   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-04-24T00:53:25,481   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-04-24T00:53:25,486   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-04-24T00:53:25,491   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-04-24T00:53:25,494   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-04-24T00:53:25,498   adding 'deepspeed/runtime/zero/__init__.py'
2024-04-24T00:53:25,503   adding 'deepspeed/runtime/zero/config.py'
2024-04-24T00:53:25,507   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-04-24T00:53:25,511   adding 'deepspeed/runtime/zero/linear.py'
2024-04-24T00:53:25,518   adding 'deepspeed/runtime/zero/mics.py'
2024-04-24T00:53:25,522   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-04-24T00:53:25,525   adding 'deepspeed/runtime/zero/offload_config.py'
2024-04-24T00:53:25,531   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-04-24T00:53:25,560   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-04-24T00:53:25,570   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-04-24T00:53:25,573   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-04-24T00:53:25,609   adding 'deepspeed/runtime/zero/stage3.py'
2024-04-24T00:53:25,644   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-04-24T00:53:25,650   adding 'deepspeed/runtime/zero/test.py'
2024-04-24T00:53:25,654   adding 'deepspeed/runtime/zero/tiling.py'
2024-04-24T00:53:25,658   adding 'deepspeed/runtime/zero/utils.py'
2024-04-24T00:53:25,661   adding 'deepspeed/sequence/__init__.py'
2024-04-24T00:53:25,664   adding 'deepspeed/sequence/layer.py'
2024-04-24T00:53:25,668   adding 'deepspeed/utils/__init__.py'
2024-04-24T00:53:25,671   adding 'deepspeed/utils/bwc.py'
2024-04-24T00:53:25,675   adding 'deepspeed/utils/comms_logging.py'
2024-04-24T00:53:25,678   adding 'deepspeed/utils/debug.py'
2024-04-24T00:53:25,680   adding 'deepspeed/utils/exceptions.py'
2024-04-24T00:53:25,687   adding 'deepspeed/utils/groups.py'
2024-04-24T00:53:25,690   adding 'deepspeed/utils/init_on_device.py'
2024-04-24T00:53:25,693   adding 'deepspeed/utils/logging.py'
2024-04-24T00:53:25,696   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-04-24T00:53:25,700   adding 'deepspeed/utils/numa.py'
2024-04-24T00:53:25,702   adding 'deepspeed/utils/nvtx.py'
2024-04-24T00:53:25,707   adding 'deepspeed/utils/tensor_fragment.py'
2024-04-24T00:53:25,711   adding 'deepspeed/utils/timer.py'
2024-04-24T00:53:25,713   adding 'deepspeed/utils/torch.py'
2024-04-24T00:53:25,716   adding 'deepspeed/utils/types.py'
2024-04-24T00:53:25,719   adding 'deepspeed/utils/z3_leaf_module.py'
2024-04-24T00:53:25,726   adding 'deepspeed/utils/zero_to_fp32.py'
2024-04-24T00:53:25,731   adding 'deepspeed-0.14.2.data/scripts/deepspeed'
2024-04-24T00:53:25,733   adding 'deepspeed-0.14.2.data/scripts/deepspeed.pt'
2024-04-24T00:53:25,735   adding 'deepspeed-0.14.2.data/scripts/ds'
2024-04-24T00:53:25,738   adding 'deepspeed-0.14.2.data/scripts/ds_bench'
2024-04-24T00:53:25,741   adding 'deepspeed-0.14.2.data/scripts/ds_elastic'
2024-04-24T00:53:25,743   adding 'deepspeed-0.14.2.data/scripts/ds_report'
2024-04-24T00:53:25,745   adding 'deepspeed-0.14.2.data/scripts/ds_ssh'
2024-04-24T00:53:25,748   adding 'deepspeed-0.14.2.data/scripts/dsr'
2024-04-24T00:53:25,761   adding 'deepspeed-0.14.2.dist-info/METADATA'
2024-04-24T00:53:25,764   adding 'deepspeed-0.14.2.dist-info/WHEEL'
2024-04-24T00:53:25,766   adding 'deepspeed-0.14.2.dist-info/entry_points.txt'
2024-04-24T00:53:25,768   adding 'deepspeed-0.14.2.dist-info/top_level.txt'
2024-04-24T00:53:25,792   adding 'deepspeed-0.14.2.dist-info/RECORD'
2024-04-24T00:53:25,868   removing build/bdist.linux-armv7l/wheel
2024-04-24T00:53:26,324   deepspeed build time = 21.70564293861389 secs
2024-04-24T00:53:26,519   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-04-24T00:53:26,568   Created wheel for deepspeed: filename=deepspeed-0.14.2-py3-none-any.whl size=1432210 sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46
2024-04-24T00:53:26,570   Stored in directory: /tmp/pip-ephem-wheel-cache-fa49k7yx/wheels/ca/69/c5/78cacd6e2244666387b06f6c3d0bc2c30b45c364193d7ab167
2024-04-24T00:53:26,674 Successfully built deepspeed
2024-04-24T00:53:26,793 Removed build tracker: '/tmp/pip-build-tracker-5yu7dyo6'