2024-08-22T23:16:54,184 Created temporary directory: /tmp/pip-build-tracker-9a5rrot2
2024-08-22T23:16:54,185 Initialized build tracking at /tmp/pip-build-tracker-9a5rrot2
2024-08-22T23:16:54,186 Created build tracker: /tmp/pip-build-tracker-9a5rrot2
2024-08-22T23:16:54,186 Entered build tracker: /tmp/pip-build-tracker-9a5rrot2
2024-08-22T23:16:54,187 Created temporary directory: /tmp/pip-wheel-skz0873v
2024-08-22T23:16:54,191 Created temporary directory: /tmp/pip-ephem-wheel-cache-nt5ez9er
2024-08-22T23:16:54,235 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-08-22T23:16:54,238 2 location(s) to search for versions of deepspeed:
2024-08-22T23:16:54,238 * https://pypi.org/simple/deepspeed/
2024-08-22T23:16:54,238 * https://www.piwheels.org/simple/deepspeed/
2024-08-22T23:16:54,239 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-08-22T23:16:54,240 Getting page https://pypi.org/simple/deepspeed/
2024-08-22T23:16:54,241 Found index url https://pypi.org/simple/
2024-08-22T23:16:54,451 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-08-22T23:16:54,469   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-22T23:16:54,470   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-08-22T23:16:54,470   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-22T23:16:54,471   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-08-22T23:16:54,472   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-22T23:16:54,472   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-08-22T23:16:54,473   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-22T23:16:54,474   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-08-22T23:16:54,474   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-22T23:16:54,475   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-08-22T23:16:54,476   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-08-22T23:16:54,476   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-08-22T23:16:54,478   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-08-22T23:16:54,479   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-08-22T23:16:54,479   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-08-22T23:16:54,480   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-08-22T23:16:54,480   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-08-22T23:16:54,481   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-08-22T23:16:54,481   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-08-22T23:16:54,482   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-08-22T23:16:54,483   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-08-22T23:16:54,483   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-08-22T23:16:54,484   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-08-22T23:16:54,485   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-08-22T23:16:54,485   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-08-22T23:16:54,486   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-08-22T23:16:54,487   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-08-22T23:16:54,488   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-08-22T23:16:54,488   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-08-22T23:16:54,489   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-08-22T23:16:54,490   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-08-22T23:16:54,491   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-08-22T23:16:54,491   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-08-22T23:16:54,492   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-08-22T23:16:54,492   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-08-22T23:16:54,493   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-08-22T23:16:54,493   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-08-22T23:16:54,494   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-08-22T23:16:54,495   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-08-22T23:16:54,495   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-08-22T23:16:54,496   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-08-22T23:16:54,497   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-08-22T23:16:54,498   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-08-22T23:16:54,498   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-08-22T23:16:54,499   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-08-22T23:16:54,500   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-08-22T23:16:54,501   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-08-22T23:16:54,501   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-08-22T23:16:54,502   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-08-22T23:16:54,503   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-08-22T23:16:54,504   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-08-22T23:16:54,505   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-08-22T23:16:54,505   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-08-22T23:16:54,506   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-08-22T23:16:54,506   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-08-22T23:16:54,507   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-08-22T23:16:54,508   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-08-22T23:16:54,508   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-08-22T23:16:54,509   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-08-22T23:16:54,510   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-08-22T23:16:54,510   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-08-22T23:16:54,511   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-08-22T23:16:54,512   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-08-22T23:16:54,513   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-08-22T23:16:54,513   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-08-22T23:16:54,514   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-08-22T23:16:54,515   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-08-22T23:16:54,515   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-08-22T23:16:54,516   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-08-22T23:16:54,517   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-08-22T23:16:54,518   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-08-22T23:16:54,518   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-08-22T23:16:54,519   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-08-22T23:16:54,519   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-08-22T23:16:54,520   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-08-22T23:16:54,521   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-08-22T23:16:54,521   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-08-22T23:16:54,522   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-08-22T23:16:54,523   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-08-22T23:16:54,524   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-08-22T23:16:54,524   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-08-22T23:16:54,525   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-08-22T23:16:54,526   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-08-22T23:16:54,526   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-08-22T23:16:54,527   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-08-22T23:16:54,528   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-08-22T23:16:54,529   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-08-22T23:16:54,529   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-08-22T23:16:54,530   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-08-22T23:16:54,531   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-08-22T23:16:54,531   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-08-22T23:16:54,532   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-08-22T23:16:54,532   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-08-22T23:16:54,533   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-08-22T23:16:54,533   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-08-22T23:16:54,534   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-08-22T23:16:54,535   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-08-22T23:16:54,535   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-08-22T23:16:54,536   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2024-08-22T23:16:54,537 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-08-22T23:16:54,538 Getting page https://www.piwheels.org/simple/deepspeed/
2024-08-22T23:16:54,539 Found index url https://www.piwheels.org/simple/
2024-08-22T23:16:54,691 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-08-22T23:16:54,709   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,710   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,710   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,711   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,712   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,712   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,712   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,713   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,713   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,714   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,715   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,715   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,716   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,717   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,718   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,718   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,719   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,720   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,720   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,721   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,721   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,722   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,722   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,723   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,723   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,724   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,724   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,725   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,726   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,727   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,727   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,728   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,729   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,730   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,730   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,730   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,731   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,731   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,732   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,732   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,733   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,733   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,734   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,734   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,735   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,735   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,736   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,736   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,737   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,738   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,738   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,739   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,739   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,740   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,740   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,741   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,741   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,742   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,742   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,743   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,743   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,744   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,744   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,745   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,745   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,746   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,746   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-08-22T23:16:54,747 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-08-22T23:16:54,747 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-08-22T23:16:54,779 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-08-22T23:16:54,781 Collecting deepspeed==0.15.0
2024-08-22T23:16:54,784   Created temporary directory: /tmp/pip-unpack-9ufmxw1k
2024-08-22T23:16:54,915   Downloading deepspeed-0.15.0.tar.gz (1.4 MB)
2024-08-22T23:16:57,233   Added deepspeed==0.15.0 from https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz to build tracker '/tmp/pip-build-tracker-9a5rrot2'
2024-08-22T23:16:57,236   Running setup.py (path:/tmp/pip-wheel-skz0873v/deepspeed_181e0b99c80b440a965fe179bd92ba21/setup.py) egg_info for package deepspeed
2024-08-22T23:16:57,237   Created temporary directory: /tmp/pip-pip-egg-info-dy690pze
2024-08-22T23:16:57,238   Preparing metadata (setup.py): started
2024-08-22T23:16:57,240   Running command python setup.py egg_info
2024-08-22T23:16:58,183   fatal: not a git repository (or any of the parent directories): .git
2024-08-22T23:16:58,863   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-08-22T23:16:58,863    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-08-22T23:16:58,864   DS_BUILD_OPS=0
2024-08-22T23:16:58,864    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:16:58,865    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:16:58,866    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:16:58,866    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:16:58,867    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:16:58,867    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:16:58,868   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-08-22T23:16:58,868   version=0.15.0, git_hash=unknown, git_branch=unknown
2024-08-22T23:16:58,869   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-08-22T23:16:58,870   ext_modules=[]
2024-08-22T23:16:58,870   running egg_info
2024-08-22T23:16:58,871   creating /tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info
2024-08-22T23:16:58,896   writing /tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info/PKG-INFO
2024-08-22T23:16:58,929   writing dependency_links to /tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info/dependency_links.txt
2024-08-22T23:16:58,931   writing entry points to /tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info/entry_points.txt
2024-08-22T23:16:58,949   writing requirements to /tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info/requires.txt
2024-08-22T23:16:58,950   writing top-level names to /tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info/top_level.txt
2024-08-22T23:16:58,952   writing manifest file '/tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info/SOURCES.txt'
2024-08-22T23:16:59,186   reading manifest file '/tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info/SOURCES.txt'
2024-08-22T23:16:59,187   reading manifest template 'MANIFEST.in'
2024-08-22T23:16:59,190   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-08-22T23:16:59,191   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-08-22T23:17:00,708   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-08-22T23:17:01,630   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-08-22T23:17:02,285   warning: no files found matching '*.tr' under directory 'csrc'
2024-08-22T23:17:02,425   warning: no files found matching '*.cc' under directory 'csrc'
2024-08-22T23:17:02,468   warning: no files found matching '*.py' under directory 'benchmarks'
2024-08-22T23:17:02,474   adding license file 'LICENSE'
2024-08-22T23:17:02,510   writing manifest file '/tmp/pip-pip-egg-info-dy690pze/deepspeed.egg-info/SOURCES.txt'
2024-08-22T23:17:02,512   deepspeed build time = 4.3259735107421875 secs
2024-08-22T23:17:02,632   Preparing metadata (setup.py): finished with status 'done'
2024-08-22T23:17:02,638   Source in /tmp/pip-wheel-skz0873v/deepspeed_181e0b99c80b440a965fe179bd92ba21 has version 0.15.0, which satisfies requirement deepspeed==0.15.0 from https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz
2024-08-22T23:17:02,639   Removed deepspeed==0.15.0 from https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz from build tracker '/tmp/pip-build-tracker-9a5rrot2'
2024-08-22T23:17:02,710 Created temporary directory: /tmp/pip-unpack-vx23npkk
2024-08-22T23:17:02,711 Created temporary directory: /tmp/pip-unpack-ylygtdjf
2024-08-22T23:17:02,712 Building wheels for collected packages: deepspeed
2024-08-22T23:17:02,716   Created temporary directory: /tmp/pip-wheel-x167tbwj
2024-08-22T23:17:02,716   Building wheel for deepspeed (setup.py): started
2024-08-22T23:17:02,718   Destination directory: /tmp/pip-wheel-x167tbwj
2024-08-22T23:17:02,718   Running command python setup.py bdist_wheel
2024-08-22T23:17:03,214   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-08-22T23:17:03,222    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-08-22T23:17:03,297   DS_BUILD_OPS=0
2024-08-22T23:17:03,410    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:17:03,411    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:17:03,412    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:17:03,412    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:17:03,412    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:17:03,413    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-22T23:17:03,413   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-08-22T23:17:03,422   fatal: not a git repository (or any of the parent directories): .git
2024-08-22T23:17:03,424   version=0.15.0, git_hash=unknown, git_branch=unknown
2024-08-22T23:17:03,425   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-08-22T23:17:03,425   ext_modules=[]
2024-08-22T23:17:04,033   running bdist_wheel
2024-08-22T23:17:04,161   running build
2024-08-22T23:17:04,162   running build_py
2024-08-22T23:17:04,191   creating build
2024-08-22T23:17:04,192   creating build/lib
2024-08-22T23:17:04,192   creating build/lib/deepspeed
2024-08-22T23:17:04,194   copying deepspeed/constants.py -> build/lib/deepspeed
2024-08-22T23:17:04,196   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-08-22T23:17:04,198   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-08-22T23:17:04,200   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-08-22T23:17:04,202   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-08-22T23:17:04,204   creating build/lib/deepspeed/autotuning
2024-08-22T23:17:04,205   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-08-22T23:17:04,208   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-08-22T23:17:04,210   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-08-22T23:17:04,212   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-08-22T23:17:04,214   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-08-22T23:17:04,217   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-08-22T23:17:04,220   creating build/lib/deepspeed/moe
2024-08-22T23:17:04,221   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-08-22T23:17:04,223   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-08-22T23:17:04,225   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-08-22T23:17:04,226   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-08-22T23:17:04,229   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-08-22T23:17:04,230   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-08-22T23:17:04,233   creating build/lib/deepspeed/model_implementations
2024-08-22T23:17:04,234   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-08-22T23:17:04,237   creating build/lib/deepspeed/utils
2024-08-22T23:17:04,238   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,241   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,242   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,244   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,246   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,247   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,249   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,251   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,253   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,255   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,256   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,258   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,260   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,262   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,264   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,265   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,268   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,270   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-08-22T23:17:04,272   creating build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,273   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,275   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,276   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,278   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,280   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,283   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,285   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,287   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,288   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,291   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-08-22T23:17:04,294   creating build/lib/deepspeed/runtime
2024-08-22T23:17:04,295   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,297   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,300   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,302   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,304   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,307   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,308   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,310   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,312   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,314   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,316   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,318   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,323   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,326   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,327   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,330   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,332   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,335   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-08-22T23:17:04,338   creating build/lib/deepspeed/comm
2024-08-22T23:17:04,339   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,341   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,343   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,345   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,348   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,349   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,350   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,352   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,354   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-08-22T23:17:04,357   creating build/lib/deepspeed/module_inject
2024-08-22T23:17:04,358   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,360   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,361   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,364   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,365   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,368   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,370   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,372   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,374   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,375   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,378   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,381   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,383   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-08-22T23:17:04,386   creating build/lib/deepspeed/compression
2024-08-22T23:17:04,387   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-08-22T23:17:04,389   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-08-22T23:17:04,391   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-08-22T23:17:04,393   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-08-22T23:17:04,395   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-08-22T23:17:04,398   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-08-22T23:17:04,400   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-08-22T23:17:04,402   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-08-22T23:17:04,405   creating build/lib/deepspeed/monitor
2024-08-22T23:17:04,406   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-08-22T23:17:04,408   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-08-22T23:17:04,410   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-08-22T23:17:04,412   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-08-22T23:17:04,414   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-08-22T23:17:04,416   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-08-22T23:17:04,418   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-08-22T23:17:04,420   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-08-22T23:17:04,422   creating build/lib/deepspeed/sequence
2024-08-22T23:17:04,423   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2024-08-22T23:17:04,425   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-08-22T23:17:04,427   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-08-22T23:17:04,429   creating build/lib/deepspeed/accelerator
2024-08-22T23:17:04,430   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,432   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,434   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,436   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,438   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,440   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,442   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,444   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,446   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-22T23:17:04,449   creating build/lib/deepspeed/profiling
2024-08-22T23:17:04,450   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-08-22T23:17:04,451   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-08-22T23:17:04,453   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-08-22T23:17:04,455   creating build/lib/deepspeed/pipe
2024-08-22T23:17:04,456   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-08-22T23:17:04,458   creating build/lib/deepspeed/elasticity
2024-08-22T23:17:04,459   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-08-22T23:17:04,461   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-08-22T23:17:04,463   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-08-22T23:17:04,465   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-08-22T23:17:04,467   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-08-22T23:17:04,469   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-08-22T23:17:04,472   creating build/lib/deepspeed/inference
2024-08-22T23:17:04,472   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-08-22T23:17:04,474   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-08-22T23:17:04,477   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-08-22T23:17:04,480   creating build/lib/deepspeed/nebula
2024-08-22T23:17:04,481   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-08-22T23:17:04,483   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-08-22T23:17:04,484   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-08-22T23:17:04,487   creating build/lib/deepspeed/linear
2024-08-22T23:17:04,488   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-08-22T23:17:04,490   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-08-22T23:17:04,492   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-08-22T23:17:04,495   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-08-22T23:17:04,496   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-08-22T23:17:04,499   creating build/lib/deepspeed/launcher
2024-08-22T23:17:04,500   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-08-22T23:17:04,502   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-08-22T23:17:04,504   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-08-22T23:17:04,506   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-08-22T23:17:04,508   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-08-22T23:17:04,510   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-08-22T23:17:04,512   creating build/lib/deepspeed/ops
2024-08-22T23:17:04,513   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-08-22T23:17:04,515   creating build/lib/deepspeed/autotuning/tuner
2024-08-22T23:17:04,516   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-08-22T23:17:04,518   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-08-22T23:17:04,520   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-08-22T23:17:04,522   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-08-22T23:17:04,523   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-08-22T23:17:04,525   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-08-22T23:17:04,527   creating build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,528   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,530   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,532   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,533   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,535   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,537   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,538   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,540   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,542   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,544   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-22T23:17:04,546   creating build/lib/deepspeed/model_implementations/features
2024-08-22T23:17:04,548   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-08-22T23:17:04,549   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-08-22T23:17:04,552   creating build/lib/deepspeed/model_implementations/diffusers
2024-08-22T23:17:04,553   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-08-22T23:17:04,554   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-08-22T23:17:04,556   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-08-22T23:17:04,559   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-08-22T23:17:04,560   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-08-22T23:17:04,562   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-08-22T23:17:04,565   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-08-22T23:17:04,568   creating build/lib/deepspeed/runtime/data_pipeline
2024-08-22T23:17:04,570   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-08-22T23:17:04,573   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-08-22T23:17:04,574   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-08-22T23:17:04,577   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-08-22T23:17:04,581   creating build/lib/deepspeed/runtime/comm
2024-08-22T23:17:04,582   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-08-22T23:17:04,585   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-08-22T23:17:04,588   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-08-22T23:17:04,591   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-08-22T23:17:04,594   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-08-22T23:17:04,596   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-08-22T23:17:04,600   creating build/lib/deepspeed/runtime/compression
2024-08-22T23:17:04,602   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-08-22T23:17:04,604   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-08-22T23:17:04,608   creating build/lib/deepspeed/runtime/fp16
2024-08-22T23:17:04,609   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-08-22T23:17:04,612   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-08-22T23:17:04,615   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-08-22T23:17:04,619   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-08-22T23:17:04,623   creating build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,625   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,628   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,631   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,636   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,638   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,641   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,646   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,652   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,654   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,656   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,659   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,662   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,664   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,666   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,669   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,671   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-08-22T23:17:04,674   creating build/lib/deepspeed/runtime/pipe
2024-08-22T23:17:04,675   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-08-22T23:17:04,677   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-08-22T23:17:04,680   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-08-22T23:17:04,681   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-08-22T23:17:04,684   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-08-22T23:17:04,688   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-08-22T23:17:04,691   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:04,692   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:04,694   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:04,696   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:04,698   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:04,700   creating build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,701   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,703   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,706   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,707   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,710   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,712   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,714   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,716   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,718   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-22T23:17:04,721   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:04,722   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:04,724   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:04,726   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:04,728   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:04,730   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:04,733   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:04,734   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:04,736   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:04,739   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:04,741   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:04,743   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:04,746   creating build/lib/deepspeed/runtime/fp16/onebit
2024-08-22T23:17:04,747   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-08-22T23:17:04,750   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-08-22T23:17:04,752   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-08-22T23:17:04,754   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-08-22T23:17:04,757   creating build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,758   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,760   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,762   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,765   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,766   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,769   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,771   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,773   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,775   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,778   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,780   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,782   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,783   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,785   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,788   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,790   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,792   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,794   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,796   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-08-22T23:17:04,798   creating build/lib/deepspeed/module_inject/containers/features
2024-08-22T23:17:04,800   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-22T23:17:04,802   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-22T23:17:04,804   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-22T23:17:04,806   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-22T23:17:04,808   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-22T23:17:04,810   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-22T23:17:04,812   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-22T23:17:04,815   creating build/lib/deepspeed/profiling/flops_profiler
2024-08-22T23:17:04,816   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-08-22T23:17:04,818   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-08-22T23:17:04,821   creating build/lib/deepspeed/inference/quantization
2024-08-22T23:17:04,822   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-08-22T23:17:04,824   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-08-22T23:17:04,826   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-08-22T23:17:04,828   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-08-22T23:17:04,830   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-08-22T23:17:04,832   creating build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,833   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,835   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,837   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,839   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,841   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,843   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,845   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,847   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,849   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-08-22T23:17:04,852   creating build/lib/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:04,853   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:04,855   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:04,858   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:04,860   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:04,862   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:04,864   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:04,867   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:04,869   creating build/lib/deepspeed/inference/v2/checkpoint
2024-08-22T23:17:04,871   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-08-22T23:17:04,873   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-08-22T23:17:04,875   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-08-22T23:17:04,876   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-08-22T23:17:04,879   creating build/lib/deepspeed/inference/v2/ragged
2024-08-22T23:17:04,880   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-22T23:17:04,882   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-22T23:17:04,884   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-22T23:17:04,886   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-22T23:17:04,888   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-22T23:17:04,890   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-22T23:17:04,892   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-22T23:17:04,895   creating build/lib/deepspeed/inference/v2/kernels
2024-08-22T23:17:04,895   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-08-22T23:17:04,897   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-08-22T23:17:04,899   creating build/lib/deepspeed/inference/v2/modules
2024-08-22T23:17:04,900   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-08-22T23:17:04,903   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-08-22T23:17:04,904   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-08-22T23:17:04,906   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-08-22T23:17:04,908   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:04,909   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:04,911   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:04,912   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:04,915   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:04,918   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,919   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,921   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,923   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,925   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,927   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,928   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,930   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,932   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,934   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:04,937   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:04,938   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:04,940   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:04,942   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:04,944   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:04,946   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:04,947   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:04,949   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:04,951   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:04,952   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:04,955   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:04,956   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:04,958   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:04,960   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:04,962   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:04,964   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:04,966   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:04,967   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:04,969   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:04,971   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:04,974   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:04,975   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:04,977   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:04,979   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:04,981   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:04,983   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:04,984   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:04,986   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:04,988   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:04,990   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:04,993   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:04,994   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:04,995   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:04,997   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:05,000   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:05,002   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:05,003   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:05,005   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:05,007   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:05,009   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:05,012   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:05,013   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:05,015   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:05,016   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:05,019   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:05,022   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,023   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,025   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,027   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,029   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,030   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,032   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,034   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,036   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,038   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:05,040   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-08-22T23:17:05,041   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-08-22T23:17:05,043   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-08-22T23:17:05,044   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-08-22T23:17:05,047   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-08-22T23:17:05,047   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-08-22T23:17:05,050   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:05,051   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:05,053   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:05,055   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:05,056   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:05,058   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:05,060   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:05,062   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:05,063   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:05,065   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:05,067   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:05,068   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:05,071   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:05,072   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:05,074   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:05,076   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:05,078   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:05,079   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:05,081   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:05,083   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:05,085   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:05,087   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:05,088   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:05,090   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:05,092   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:05,093   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:05,095   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:05,097   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:05,098   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:05,100   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:05,102   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:05,103   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:05,105   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:05,107   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:05,108   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:05,110   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:05,112   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:05,113   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:05,115   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:05,118   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:05,119   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:05,121   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:05,123   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:05,124   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:05,126   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:05,128   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:05,130   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:05,132   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:05,134   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:05,135   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:05,138   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:05,139   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:05,140   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:05,143   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:05,144   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:05,146   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:05,148   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,149   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,151   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,153   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,155   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,157   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,158   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,160   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,162   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:05,164   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-08-22T23:17:05,166   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-08-22T23:17:05,168   creating build/lib/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:05,169   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:05,171   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:05,173   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:05,175   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:05,177   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:05,179   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:05,181   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:05,183   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-08-22T23:17:05,184   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-08-22T23:17:05,186   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-08-22T23:17:05,189   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-08-22T23:17:05,190   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-08-22T23:17:05,191   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-08-22T23:17:05,194   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-08-22T23:17:05,195   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-08-22T23:17:05,197   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-08-22T23:17:05,199   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-22T23:17:05,200   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-22T23:17:05,202   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-22T23:17:05,204   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-22T23:17:05,206   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-08-22T23:17:05,207   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-08-22T23:17:05,209   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-08-22T23:17:05,211   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-08-22T23:17:05,212   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-08-22T23:17:05,215   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-08-22T23:17:05,217   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-08-22T23:17:05,220   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-08-22T23:17:05,220   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-08-22T23:17:05,223   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-08-22T23:17:05,226   creating build/lib/deepspeed/ops/random_ltd
2024-08-22T23:17:05,226   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-08-22T23:17:05,228   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-08-22T23:17:05,231   creating build/lib/deepspeed/ops/fp_quantizer
2024-08-22T23:17:05,232   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-08-22T23:17:05,234   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-08-22T23:17:05,236   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-08-22T23:17:05,239   creating build/lib/deepspeed/ops/lion
2024-08-22T23:17:05,240   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-08-22T23:17:05,242   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-08-22T23:17:05,244   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-08-22T23:17:05,246   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-08-22T23:17:05,248   creating build/lib/deepspeed/ops/adam
2024-08-22T23:17:05,249   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-08-22T23:17:05,251   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-08-22T23:17:05,253   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-08-22T23:17:05,255   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-08-22T23:17:05,257   creating build/lib/deepspeed/ops/sparse_attention
2024-08-22T23:17:05,258   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-22T23:17:05,262   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-22T23:17:05,263   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-22T23:17:05,266   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-22T23:17:05,268   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-22T23:17:05,270   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-22T23:17:05,273   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-22T23:17:05,276   creating build/lib/deepspeed/ops/adagrad
2024-08-22T23:17:05,276   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-08-22T23:17:05,278   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-08-22T23:17:05,281   creating build/lib/deepspeed/ops/quantizer
2024-08-22T23:17:05,282   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-08-22T23:17:05,284   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-08-22T23:17:05,286   creating build/lib/deepspeed/ops/lamb
2024-08-22T23:17:05,287   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-08-22T23:17:05,289   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-08-22T23:17:05,292   creating build/lib/deepspeed/ops/aio
2024-08-22T23:17:05,293   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-08-22T23:17:05,295   creating build/lib/deepspeed/ops/gds
2024-08-22T23:17:05,296   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2024-08-22T23:17:05,298   creating build/lib/deepspeed/ops/transformer
2024-08-22T23:17:05,299   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-08-22T23:17:05,302   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-08-22T23:17:05,304   creating build/lib/deepspeed/ops/deepspeed4science
2024-08-22T23:17:05,305   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-08-22T23:17:05,307   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-08-22T23:17:05,310   creating build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,311   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,314   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,315   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,317   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,319   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,321   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,323   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,324   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,326   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,328   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,330   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,331   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,333   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,335   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,336   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,338   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,340   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,342   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,344   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,346   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,348   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,350   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,352   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,354   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-08-22T23:17:05,356   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:05,357   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:05,360   creating build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,361   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,363   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,365   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,367   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,370   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,372   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,374   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,376   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,379   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,381   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-22T23:17:05,384   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,385   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,388   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,390   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,392   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,394   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,396   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,398   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,400   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,402   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,404   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:05,407   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,408   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,410   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,412   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,414   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,416   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,418   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,420   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,422   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,424   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,426   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:05,428   creating build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,429   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,431   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,433   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,435   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,438   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,439   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,441   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,443   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,445   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-22T23:17:05,448   creating build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,448   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,450   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,452   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,454   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,456   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,458   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,459   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,461   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,463   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,464   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:05,467   creating build/lib/deepspeed/ops/op_builder/cpu
2024-08-22T23:17:05,468   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-22T23:17:05,471   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-22T23:17:05,473   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-22T23:17:05,474   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-22T23:17:05,476   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-22T23:17:05,478   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-22T23:17:05,481   creating build/lib/deepspeed/ops/op_builder/hpu
2024-08-22T23:17:05,482   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-22T23:17:05,484   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-22T23:17:05,486   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-22T23:17:05,488   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-22T23:17:05,490   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-22T23:17:05,492   running egg_info
2024-08-22T23:17:05,519   writing deepspeed.egg-info/PKG-INFO
2024-08-22T23:17:05,553   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-08-22T23:17:05,555   writing entry points to deepspeed.egg-info/entry_points.txt
2024-08-22T23:17:05,572   writing requirements to deepspeed.egg-info/requires.txt
2024-08-22T23:17:05,573   writing top-level names to deepspeed.egg-info/top_level.txt
2024-08-22T23:17:05,700   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-08-22T23:17:05,788   reading manifest template 'MANIFEST.in'
2024-08-22T23:17:05,790   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-08-22T23:17:05,791   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-08-22T23:17:07,346   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-08-22T23:17:08,262   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-08-22T23:17:08,886   warning: no files found matching '*.tr' under directory 'csrc'
2024-08-22T23:17:09,007   warning: no files found matching '*.cc' under directory 'csrc'
2024-08-22T23:17:09,046   warning: no files found matching '*.py' under directory 'benchmarks'
2024-08-22T23:17:09,052   adding license file 'LICENSE'
2024-08-22T23:17:09,098   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-08-22T23:17:09,106   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-08-22T23:17:09,106   !!

2024-08-22T23:17:09,107           ********************************************************************************
2024-08-22T23:17:09,108           ############################
2024-08-22T23:17:09,108           # Package would be ignored #
2024-08-22T23:17:09,108           ############################
2024-08-22T23:17:09,109           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-08-22T23:17:09,109           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,110           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,111           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-08-22T23:17:09,111           to the `packages` configuration field.

2024-08-22T23:17:09,112           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,112           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,113           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,114           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,115           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,116           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-08-22T23:17:09,116           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-08-22T23:17:09,117           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,118           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,118           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,120           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,121           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,123           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,123                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,124                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,125                 directory, all directories are treated like packages.
2024-08-22T23:17:09,125           ********************************************************************************

2024-08-22T23:17:09,126   !!
2024-08-22T23:17:09,127     check.warn(importable)
2024-08-22T23:17:09,127   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-08-22T23:17:09,128   !!

2024-08-22T23:17:09,129           ********************************************************************************
2024-08-22T23:17:09,130           ############################
2024-08-22T23:17:09,130           # Package would be ignored #
2024-08-22T23:17:09,131           ############################
2024-08-22T23:17:09,131           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-08-22T23:17:09,132           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,133           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,133           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-08-22T23:17:09,134           to the `packages` configuration field.

2024-08-22T23:17:09,135           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,135           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,136           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,136           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,137           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,138           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-08-22T23:17:09,138           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-08-22T23:17:09,138           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,139           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,139           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,140           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,140           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,142           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,142                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,142                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,143                 directory, all directories are treated like packages.
2024-08-22T23:17:09,143           ********************************************************************************

2024-08-22T23:17:09,144   !!
2024-08-22T23:17:09,146     check.warn(importable)
2024-08-22T23:17:09,146   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-08-22T23:17:09,147   !!

2024-08-22T23:17:09,148           ********************************************************************************
2024-08-22T23:17:09,148           ############################
2024-08-22T23:17:09,149           # Package would be ignored #
2024-08-22T23:17:09,149           ############################
2024-08-22T23:17:09,150           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-08-22T23:17:09,150           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,151           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,152           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-08-22T23:17:09,152           to the `packages` configuration field.

2024-08-22T23:17:09,153           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,153           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,154           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,155           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,156           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,157           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-08-22T23:17:09,157           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-08-22T23:17:09,158           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,158           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,159           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,160           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,161           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,162           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,162                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,162                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,163                 directory, all directories are treated like packages.
2024-08-22T23:17:09,163           ********************************************************************************

2024-08-22T23:17:09,164   !!
2024-08-22T23:17:09,164     check.warn(importable)
2024-08-22T23:17:09,164   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-08-22T23:17:09,165   !!

2024-08-22T23:17:09,165           ********************************************************************************
2024-08-22T23:17:09,166           ############################
2024-08-22T23:17:09,166           # Package would be ignored #
2024-08-22T23:17:09,166           ############################
2024-08-22T23:17:09,167           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-08-22T23:17:09,167           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,168           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,169           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-08-22T23:17:09,169           to the `packages` configuration field.

2024-08-22T23:17:09,170           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,171           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,171           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,173           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,174           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,175           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-08-22T23:17:09,175           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-08-22T23:17:09,176           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,176           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,177           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,178           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,179           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,180           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,181                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,181                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,182                 directory, all directories are treated like packages.
2024-08-22T23:17:09,182           ********************************************************************************

2024-08-22T23:17:09,183   !!
2024-08-22T23:17:09,184     check.warn(importable)
2024-08-22T23:17:09,185   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-08-22T23:17:09,186   !!

2024-08-22T23:17:09,187           ********************************************************************************
2024-08-22T23:17:09,187           ############################
2024-08-22T23:17:09,187           # Package would be ignored #
2024-08-22T23:17:09,188           ############################
2024-08-22T23:17:09,188           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-08-22T23:17:09,188           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,189           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,190           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-08-22T23:17:09,190           to the `packages` configuration field.

2024-08-22T23:17:09,191           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,191           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,191           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,192           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,193           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,194           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-08-22T23:17:09,194           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-08-22T23:17:09,195           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,195           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,196           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,198           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,199           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,201           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,202                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,202                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,203                 directory, all directories are treated like packages.
2024-08-22T23:17:09,204           ********************************************************************************

2024-08-22T23:17:09,205   !!
2024-08-22T23:17:09,206     check.warn(importable)
2024-08-22T23:17:09,206   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-08-22T23:17:09,207   !!

2024-08-22T23:17:09,208           ********************************************************************************
2024-08-22T23:17:09,209           ############################
2024-08-22T23:17:09,210           # Package would be ignored #
2024-08-22T23:17:09,210           ############################
2024-08-22T23:17:09,211           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-08-22T23:17:09,211           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,213           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,213           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-08-22T23:17:09,214           to the `packages` configuration field.

2024-08-22T23:17:09,215           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,216           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,217           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,218           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,219           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,220           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-08-22T23:17:09,221           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-08-22T23:17:09,221           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,221           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,222           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,223           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,224           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,225           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,226                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,226                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,227                 directory, all directories are treated like packages.
2024-08-22T23:17:09,227           ********************************************************************************

2024-08-22T23:17:09,228   !!
2024-08-22T23:17:09,229     check.warn(importable)
2024-08-22T23:17:09,229   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-08-22T23:17:09,230   !!

2024-08-22T23:17:09,231           ********************************************************************************
2024-08-22T23:17:09,232           ############################
2024-08-22T23:17:09,233           # Package would be ignored #
2024-08-22T23:17:09,233           ############################
2024-08-22T23:17:09,234           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-08-22T23:17:09,235           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,236           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,237           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-08-22T23:17:09,237           to the `packages` configuration field.

2024-08-22T23:17:09,239           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,239           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,240           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,241           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,242           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,243           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-08-22T23:17:09,244           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-08-22T23:17:09,244           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,245           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,245           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,247           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,248           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,250           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,251                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,251                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,251                 directory, all directories are treated like packages.
2024-08-22T23:17:09,252           ********************************************************************************

2024-08-22T23:17:09,253   !!
2024-08-22T23:17:09,253     check.warn(importable)
2024-08-22T23:17:09,254   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-08-22T23:17:09,254   !!

2024-08-22T23:17:09,255           ********************************************************************************
2024-08-22T23:17:09,256           ############################
2024-08-22T23:17:09,256           # Package would be ignored #
2024-08-22T23:17:09,257           ############################
2024-08-22T23:17:09,257           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-08-22T23:17:09,258           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,259           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,259           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-08-22T23:17:09,260           to the `packages` configuration field.

2024-08-22T23:17:09,261           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,262           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,263           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,264           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,266           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,268           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-08-22T23:17:09,268           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-08-22T23:17:09,269           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,270           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,270           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,271           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,273           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,274           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,275                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,275                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,276                 directory, all directories are treated like packages.
2024-08-22T23:17:09,277           ********************************************************************************

2024-08-22T23:17:09,278   !!
2024-08-22T23:17:09,278     check.warn(importable)
2024-08-22T23:17:09,279   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-08-22T23:17:09,279   !!

2024-08-22T23:17:09,281           ********************************************************************************
2024-08-22T23:17:09,281           ############################
2024-08-22T23:17:09,282           # Package would be ignored #
2024-08-22T23:17:09,283           ############################
2024-08-22T23:17:09,283           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-08-22T23:17:09,284           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,286           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,286           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-08-22T23:17:09,287           to the `packages` configuration field.

2024-08-22T23:17:09,288           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,288           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,288           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,290           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,291           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,292           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-08-22T23:17:09,292           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-08-22T23:17:09,293           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,293           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,294           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,295           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,296           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,298           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,299                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,299                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,299                 directory, all directories are treated like packages.
2024-08-22T23:17:09,300           ********************************************************************************

2024-08-22T23:17:09,301   !!
2024-08-22T23:17:09,301     check.warn(importable)
2024-08-22T23:17:09,302   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-08-22T23:17:09,302   !!

2024-08-22T23:17:09,303           ********************************************************************************
2024-08-22T23:17:09,304           ############################
2024-08-22T23:17:09,305           # Package would be ignored #
2024-08-22T23:17:09,305           ############################
2024-08-22T23:17:09,306           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-08-22T23:17:09,306           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,307           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,308           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-08-22T23:17:09,308           to the `packages` configuration field.

2024-08-22T23:17:09,309           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,310           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,310           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,311           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,312           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,313           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-08-22T23:17:09,314           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-08-22T23:17:09,314           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,315           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,316           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,316           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,317           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,318           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,319                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,319                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,319                 directory, all directories are treated like packages.
2024-08-22T23:17:09,320           ********************************************************************************

2024-08-22T23:17:09,320   !!
2024-08-22T23:17:09,321     check.warn(importable)
2024-08-22T23:17:09,321   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-08-22T23:17:09,321   !!

2024-08-22T23:17:09,322           ********************************************************************************
2024-08-22T23:17:09,322           ############################
2024-08-22T23:17:09,323           # Package would be ignored #
2024-08-22T23:17:09,323           ############################
2024-08-22T23:17:09,324           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-08-22T23:17:09,324           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,325           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,325           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-08-22T23:17:09,326           to the `packages` configuration field.

2024-08-22T23:17:09,327           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,327           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,328           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,329           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,330           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,331           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-08-22T23:17:09,332           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-08-22T23:17:09,332           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,333           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,333           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,334           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,335           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,336           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,337                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,337                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,338                 directory, all directories are treated like packages.
2024-08-22T23:17:09,338           ********************************************************************************

2024-08-22T23:17:09,339   !!
2024-08-22T23:17:09,340     check.warn(importable)
2024-08-22T23:17:09,340   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-08-22T23:17:09,341   !!

2024-08-22T23:17:09,342           ********************************************************************************
2024-08-22T23:17:09,343           ############################
2024-08-22T23:17:09,343           # Package would be ignored #
2024-08-22T23:17:09,343           ############################
2024-08-22T23:17:09,344           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-08-22T23:17:09,344           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,345           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,345           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-08-22T23:17:09,345           to the `packages` configuration field.

2024-08-22T23:17:09,346           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,346           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,347           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,347           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,348           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,349           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-08-22T23:17:09,349           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-08-22T23:17:09,350           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,350           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,350           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,352           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,353           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,355           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,355                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,356                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,356                 directory, all directories are treated like packages.
2024-08-22T23:17:09,357           ********************************************************************************

2024-08-22T23:17:09,358   !!
2024-08-22T23:17:09,358     check.warn(importable)
2024-08-22T23:17:09,359   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-08-22T23:17:09,360   !!

2024-08-22T23:17:09,361           ********************************************************************************
2024-08-22T23:17:09,361           ############################
2024-08-22T23:17:09,361           # Package would be ignored #
2024-08-22T23:17:09,362           ############################
2024-08-22T23:17:09,362           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-08-22T23:17:09,363           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,364           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,364           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-08-22T23:17:09,365           to the `packages` configuration field.

2024-08-22T23:17:09,366           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,367           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,368           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,369           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,370           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,371           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-08-22T23:17:09,371           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-08-22T23:17:09,372           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,372           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,372           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,373           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,374           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,375           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,375                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,375                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,376                 directory, all directories are treated like packages.
2024-08-22T23:17:09,376           ********************************************************************************

2024-08-22T23:17:09,377   !!
2024-08-22T23:17:09,377     check.warn(importable)
2024-08-22T23:17:09,378   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-08-22T23:17:09,378   !!

2024-08-22T23:17:09,379           ********************************************************************************
2024-08-22T23:17:09,380           ############################
2024-08-22T23:17:09,380           # Package would be ignored #
2024-08-22T23:17:09,381           ############################
2024-08-22T23:17:09,381           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-08-22T23:17:09,382           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,383           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,383           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-08-22T23:17:09,384           to the `packages` configuration field.

2024-08-22T23:17:09,385           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,386           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,386           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,387           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,388           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,389           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-08-22T23:17:09,390           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-08-22T23:17:09,390           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,391           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,391           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,392           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,393           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,395           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,395                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,396                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,397                 directory, all directories are treated like packages.
2024-08-22T23:17:09,397           ********************************************************************************

2024-08-22T23:17:09,398   !!
2024-08-22T23:17:09,399     check.warn(importable)
2024-08-22T23:17:09,399   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-08-22T23:17:09,399   !!

2024-08-22T23:17:09,400           ********************************************************************************
2024-08-22T23:17:09,400           ############################
2024-08-22T23:17:09,401           # Package would be ignored #
2024-08-22T23:17:09,401           ############################
2024-08-22T23:17:09,401           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-08-22T23:17:09,402           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,402           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,403           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-08-22T23:17:09,403           to the `packages` configuration field.

2024-08-22T23:17:09,404           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,404           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,405           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,405           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,406           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,407           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-08-22T23:17:09,408           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-08-22T23:17:09,409           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,409           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,410           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,411           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,412           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,414           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,414                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,415                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,416                 directory, all directories are treated like packages.
2024-08-22T23:17:09,416           ********************************************************************************

2024-08-22T23:17:09,417   !!
2024-08-22T23:17:09,417     check.warn(importable)
2024-08-22T23:17:09,418   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-08-22T23:17:09,418   !!

2024-08-22T23:17:09,419           ********************************************************************************
2024-08-22T23:17:09,420           ############################
2024-08-22T23:17:09,420           # Package would be ignored #
2024-08-22T23:17:09,421           ############################
2024-08-22T23:17:09,421           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-08-22T23:17:09,422           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,423           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,424           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-08-22T23:17:09,424           to the `packages` configuration field.

2024-08-22T23:17:09,425           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,426           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,426           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,427           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,427           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,428           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-08-22T23:17:09,428           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-08-22T23:17:09,429           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,429           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,430           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,430           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,431           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,432           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,432                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,433                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,433                 directory, all directories are treated like packages.
2024-08-22T23:17:09,433           ********************************************************************************

2024-08-22T23:17:09,434   !!
2024-08-22T23:17:09,435     check.warn(importable)
2024-08-22T23:17:09,435   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-08-22T23:17:09,436   !!

2024-08-22T23:17:09,437           ********************************************************************************
2024-08-22T23:17:09,437           ############################
2024-08-22T23:17:09,438           # Package would be ignored #
2024-08-22T23:17:09,439           ############################
2024-08-22T23:17:09,439           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-08-22T23:17:09,440           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,441           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,441           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-08-22T23:17:09,442           to the `packages` configuration field.

2024-08-22T23:17:09,443           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,443           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,444           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,445           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,446           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,447           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-08-22T23:17:09,447           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-08-22T23:17:09,448           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,448           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,449           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,450           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,451           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,452           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,452                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,453                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,453                 directory, all directories are treated like packages.
2024-08-22T23:17:09,453           ********************************************************************************

2024-08-22T23:17:09,454   !!
2024-08-22T23:17:09,454     check.warn(importable)
2024-08-22T23:17:09,455   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-08-22T23:17:09,455   !!

2024-08-22T23:17:09,456           ********************************************************************************
2024-08-22T23:17:09,456           ############################
2024-08-22T23:17:09,456           # Package would be ignored #
2024-08-22T23:17:09,457           ############################
2024-08-22T23:17:09,457           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-08-22T23:17:09,457           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,458           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,459           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-08-22T23:17:09,459           to the `packages` configuration field.

2024-08-22T23:17:09,460           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,461           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,461           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,462           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,463           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,465           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-08-22T23:17:09,465           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-08-22T23:17:09,466           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,466           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,467           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,468           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,469           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,470           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,471                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,471                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,472                 directory, all directories are treated like packages.
2024-08-22T23:17:09,472           ********************************************************************************

2024-08-22T23:17:09,473   !!
2024-08-22T23:17:09,474     check.warn(importable)
2024-08-22T23:17:09,474   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-08-22T23:17:09,475   !!

2024-08-22T23:17:09,476           ********************************************************************************
2024-08-22T23:17:09,476           ############################
2024-08-22T23:17:09,476           # Package would be ignored #
2024-08-22T23:17:09,477           ############################
2024-08-22T23:17:09,477           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-08-22T23:17:09,478           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,478           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,479           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-08-22T23:17:09,479           to the `packages` configuration field.

2024-08-22T23:17:09,480           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,480           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,480           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,481           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,482           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,483           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-08-22T23:17:09,483           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-08-22T23:17:09,483           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,484           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,484           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,485           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,486           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,488           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,488                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,489                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,489                 directory, all directories are treated like packages.
2024-08-22T23:17:09,490           ********************************************************************************

2024-08-22T23:17:09,491   !!
2024-08-22T23:17:09,491     check.warn(importable)
2024-08-22T23:17:09,492   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-08-22T23:17:09,492   !!

2024-08-22T23:17:09,493           ********************************************************************************
2024-08-22T23:17:09,494           ############################
2024-08-22T23:17:09,494           # Package would be ignored #
2024-08-22T23:17:09,495           ############################
2024-08-22T23:17:09,495           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-08-22T23:17:09,495           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,496           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,497           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-08-22T23:17:09,497           to the `packages` configuration field.

2024-08-22T23:17:09,499           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,499           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,500           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,501           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,501           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,502           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-08-22T23:17:09,502           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-08-22T23:17:09,503           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,503           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,503           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,504           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,505           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,506           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,506                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,506                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,507                 directory, all directories are treated like packages.
2024-08-22T23:17:09,507           ********************************************************************************

2024-08-22T23:17:09,508   !!
2024-08-22T23:17:09,509     check.warn(importable)
2024-08-22T23:17:09,509   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-08-22T23:17:09,510   !!

2024-08-22T23:17:09,511           ********************************************************************************
2024-08-22T23:17:09,511           ############################
2024-08-22T23:17:09,512           # Package would be ignored #
2024-08-22T23:17:09,512           ############################
2024-08-22T23:17:09,513           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-08-22T23:17:09,513           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,514           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,515           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-08-22T23:17:09,515           to the `packages` configuration field.

2024-08-22T23:17:09,516           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,517           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,517           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,518           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,519           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,520           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-08-22T23:17:09,521           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-08-22T23:17:09,521           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,521           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,522           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,523           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,524           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,525           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,526                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,526                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,526                 directory, all directories are treated like packages.
2024-08-22T23:17:09,527           ********************************************************************************

2024-08-22T23:17:09,527   !!
2024-08-22T23:17:09,528     check.warn(importable)
2024-08-22T23:17:09,528   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-08-22T23:17:09,528   !!

2024-08-22T23:17:09,529           ********************************************************************************
2024-08-22T23:17:09,529           ############################
2024-08-22T23:17:09,530           # Package would be ignored #
2024-08-22T23:17:09,530           ############################
2024-08-22T23:17:09,530           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-08-22T23:17:09,531           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,531           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,532           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-08-22T23:17:09,532           to the `packages` configuration field.

2024-08-22T23:17:09,533           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,533           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,534           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,535           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,536           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,537           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-08-22T23:17:09,538           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-08-22T23:17:09,538           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,539           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,539           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,540           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,541           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,543           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,543                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,544                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,544                 directory, all directories are treated like packages.
2024-08-22T23:17:09,544           ********************************************************************************

2024-08-22T23:17:09,545   !!
2024-08-22T23:17:09,546     check.warn(importable)
2024-08-22T23:17:09,546   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-08-22T23:17:09,547   !!

2024-08-22T23:17:09,548           ********************************************************************************
2024-08-22T23:17:09,548           ############################
2024-08-22T23:17:09,549           # Package would be ignored #
2024-08-22T23:17:09,549           ############################
2024-08-22T23:17:09,550           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-08-22T23:17:09,551           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,551           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,552           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-08-22T23:17:09,552           to the `packages` configuration field.

2024-08-22T23:17:09,553           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,554           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,554           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,555           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,556           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,557           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-08-22T23:17:09,557           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-08-22T23:17:09,557           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,558           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,558           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,559           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,560           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,561           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,562                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,562                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,563                 directory, all directories are treated like packages.
2024-08-22T23:17:09,564           ********************************************************************************

2024-08-22T23:17:09,565   !!
2024-08-22T23:17:09,565     check.warn(importable)
2024-08-22T23:17:09,566   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2024-08-22T23:17:09,566   !!

2024-08-22T23:17:09,568           ********************************************************************************
2024-08-22T23:17:09,568           ############################
2024-08-22T23:17:09,569           # Package would be ignored #
2024-08-22T23:17:09,569           ############################
2024-08-22T23:17:09,570           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2024-08-22T23:17:09,570           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,571           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,571           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2024-08-22T23:17:09,572           to the `packages` configuration field.

2024-08-22T23:17:09,573           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,573           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,574           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,575           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,576           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,577           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2024-08-22T23:17:09,578           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2024-08-22T23:17:09,578           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,579           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,579           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,580           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,581           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,582           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,582                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,582                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,583                 directory, all directories are treated like packages.
2024-08-22T23:17:09,583           ********************************************************************************

2024-08-22T23:17:09,584   !!
2024-08-22T23:17:09,584     check.warn(importable)
2024-08-22T23:17:09,585   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-08-22T23:17:09,585   !!

2024-08-22T23:17:09,586           ********************************************************************************
2024-08-22T23:17:09,586           ############################
2024-08-22T23:17:09,587           # Package would be ignored #
2024-08-22T23:17:09,587           ############################
2024-08-22T23:17:09,588           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-08-22T23:17:09,588           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,589           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,590           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-08-22T23:17:09,591           to the `packages` configuration field.

2024-08-22T23:17:09,592           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,592           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,593           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,594           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,595           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,596           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-08-22T23:17:09,596           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-08-22T23:17:09,597           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,597           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,598           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,599           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,600           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,602           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,602                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,603                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,603                 directory, all directories are treated like packages.
2024-08-22T23:17:09,604           ********************************************************************************

2024-08-22T23:17:09,605   !!
2024-08-22T23:17:09,606     check.warn(importable)
2024-08-22T23:17:09,606   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-08-22T23:17:09,607   !!

2024-08-22T23:17:09,608           ********************************************************************************
2024-08-22T23:17:09,608           ############################
2024-08-22T23:17:09,609           # Package would be ignored #
2024-08-22T23:17:09,609           ############################
2024-08-22T23:17:09,610           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-08-22T23:17:09,610           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,611           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,612           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-08-22T23:17:09,612           to the `packages` configuration field.

2024-08-22T23:17:09,613           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,614           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,614           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,615           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,616           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,617           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-08-22T23:17:09,617           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-08-22T23:17:09,618           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,619           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,619           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,620           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,621           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,623           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,623                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,624                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,624                 directory, all directories are treated like packages.
2024-08-22T23:17:09,625           ********************************************************************************

2024-08-22T23:17:09,626   !!
2024-08-22T23:17:09,627     check.warn(importable)
2024-08-22T23:17:09,628   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-08-22T23:17:09,628   !!

2024-08-22T23:17:09,629           ********************************************************************************
2024-08-22T23:17:09,630           ############################
2024-08-22T23:17:09,630           # Package would be ignored #
2024-08-22T23:17:09,631           ############################
2024-08-22T23:17:09,632           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-08-22T23:17:09,632           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,633           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,634           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-08-22T23:17:09,635           to the `packages` configuration field.

2024-08-22T23:17:09,636           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,636           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,637           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,638           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,639           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,640           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-08-22T23:17:09,641           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-08-22T23:17:09,641           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,641           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,642           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,643           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,644           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,645           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,646                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,646                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,646                 directory, all directories are treated like packages.
2024-08-22T23:17:09,647           ********************************************************************************

2024-08-22T23:17:09,648   !!
2024-08-22T23:17:09,648     check.warn(importable)
2024-08-22T23:17:09,649   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-08-22T23:17:09,649   !!

2024-08-22T23:17:09,651           ********************************************************************************
2024-08-22T23:17:09,651           ############################
2024-08-22T23:17:09,652           # Package would be ignored #
2024-08-22T23:17:09,652           ############################
2024-08-22T23:17:09,653           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-08-22T23:17:09,653           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,654           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,655           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-08-22T23:17:09,655           to the `packages` configuration field.

2024-08-22T23:17:09,656           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,657           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,658           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,659           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,660           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,661           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-08-22T23:17:09,661           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-08-22T23:17:09,662           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,663           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,663           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,664           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,665           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,667           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,668                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,668                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,669                 directory, all directories are treated like packages.
2024-08-22T23:17:09,670           ********************************************************************************

2024-08-22T23:17:09,671   !!
2024-08-22T23:17:09,671     check.warn(importable)
2024-08-22T23:17:09,672   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-08-22T23:17:09,672   !!

2024-08-22T23:17:09,673           ********************************************************************************
2024-08-22T23:17:09,673           ############################
2024-08-22T23:17:09,674           # Package would be ignored #
2024-08-22T23:17:09,674           ############################
2024-08-22T23:17:09,675           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-08-22T23:17:09,675           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,676           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,677           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-08-22T23:17:09,677           to the `packages` configuration field.

2024-08-22T23:17:09,678           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,679           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,679           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,680           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,681           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,682           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-08-22T23:17:09,683           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-08-22T23:17:09,683           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,684           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,684           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,685           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,687           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,688           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,689                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,689                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,690                 directory, all directories are treated like packages.
2024-08-22T23:17:09,690           ********************************************************************************

2024-08-22T23:17:09,691   !!
2024-08-22T23:17:09,692     check.warn(importable)
2024-08-22T23:17:09,693   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-08-22T23:17:09,693   !!

2024-08-22T23:17:09,694           ********************************************************************************
2024-08-22T23:17:09,695           ############################
2024-08-22T23:17:09,695           # Package would be ignored #
2024-08-22T23:17:09,696           ############################
2024-08-22T23:17:09,696           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-08-22T23:17:09,697           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,698           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,698           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-08-22T23:17:09,699           to the `packages` configuration field.

2024-08-22T23:17:09,700           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,700           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,701           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,702           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,703           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,704           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-08-22T23:17:09,704           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-08-22T23:17:09,704           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,705           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,705           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,706           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,707           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,709           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,709                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,710                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,710                 directory, all directories are treated like packages.
2024-08-22T23:17:09,711           ********************************************************************************

2024-08-22T23:17:09,712   !!
2024-08-22T23:17:09,713     check.warn(importable)
2024-08-22T23:17:09,713   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-08-22T23:17:09,713   !!

2024-08-22T23:17:09,714           ********************************************************************************
2024-08-22T23:17:09,715           ############################
2024-08-22T23:17:09,715           # Package would be ignored #
2024-08-22T23:17:09,716           ############################
2024-08-22T23:17:09,717           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-08-22T23:17:09,717           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,718           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,719           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-08-22T23:17:09,719           to the `packages` configuration field.

2024-08-22T23:17:09,720           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,721           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,722           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,723           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,724           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,725           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-08-22T23:17:09,725           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-08-22T23:17:09,726           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,726           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,727           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,728           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,729           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,730           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,731                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,731                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,732                 directory, all directories are treated like packages.
2024-08-22T23:17:09,732           ********************************************************************************

2024-08-22T23:17:09,733   !!
2024-08-22T23:17:09,733     check.warn(importable)
2024-08-22T23:17:09,734   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-08-22T23:17:09,734   !!

2024-08-22T23:17:09,735           ********************************************************************************
2024-08-22T23:17:09,735           ############################
2024-08-22T23:17:09,736           # Package would be ignored #
2024-08-22T23:17:09,736           ############################
2024-08-22T23:17:09,737           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-08-22T23:17:09,737           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,738           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,739           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-08-22T23:17:09,739           to the `packages` configuration field.

2024-08-22T23:17:09,740           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,741           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,742           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,743           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,743           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,744           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-08-22T23:17:09,745           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-08-22T23:17:09,745           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,746           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,746           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,747           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,748           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,750           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,750                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,751                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,751                 directory, all directories are treated like packages.
2024-08-22T23:17:09,752           ********************************************************************************

2024-08-22T23:17:09,753   !!
2024-08-22T23:17:09,754     check.warn(importable)
2024-08-22T23:17:09,754   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-08-22T23:17:09,755   !!

2024-08-22T23:17:09,756           ********************************************************************************
2024-08-22T23:17:09,756           ############################
2024-08-22T23:17:09,757           # Package would be ignored #
2024-08-22T23:17:09,758           ############################
2024-08-22T23:17:09,758           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-08-22T23:17:09,759           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,760           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,760           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-08-22T23:17:09,760           to the `packages` configuration field.

2024-08-22T23:17:09,762           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,762           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,763           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,763           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,765           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,766           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-08-22T23:17:09,766           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-08-22T23:17:09,767           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,768           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,768           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,769           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,770           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,772           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,772                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,773                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,774                 directory, all directories are treated like packages.
2024-08-22T23:17:09,774           ********************************************************************************

2024-08-22T23:17:09,775   !!
2024-08-22T23:17:09,776     check.warn(importable)
2024-08-22T23:17:09,776   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-08-22T23:17:09,777   !!

2024-08-22T23:17:09,778           ********************************************************************************
2024-08-22T23:17:09,778           ############################
2024-08-22T23:17:09,779           # Package would be ignored #
2024-08-22T23:17:09,779           ############################
2024-08-22T23:17:09,780           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-08-22T23:17:09,780           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,781           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,782           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-08-22T23:17:09,783           to the `packages` configuration field.

2024-08-22T23:17:09,784           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,785           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,785           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,786           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,788           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,789           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-08-22T23:17:09,790           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-08-22T23:17:09,790           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,791           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,791           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,792           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,793           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,794           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,795                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,795                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,796                 directory, all directories are treated like packages.
2024-08-22T23:17:09,797           ********************************************************************************

2024-08-22T23:17:09,798   !!
2024-08-22T23:17:09,798     check.warn(importable)
2024-08-22T23:17:09,799   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-08-22T23:17:09,799   !!

2024-08-22T23:17:09,800           ********************************************************************************
2024-08-22T23:17:09,801           ############################
2024-08-22T23:17:09,802           # Package would be ignored #
2024-08-22T23:17:09,802           ############################
2024-08-22T23:17:09,803           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-08-22T23:17:09,803           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,804           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,805           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-08-22T23:17:09,805           to the `packages` configuration field.

2024-08-22T23:17:09,807           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,807           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,808           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,809           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,810           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,811           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-08-22T23:17:09,812           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-08-22T23:17:09,813           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,814           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,814           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,815           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,816           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,818           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,819                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,819                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,820                 directory, all directories are treated like packages.
2024-08-22T23:17:09,821           ********************************************************************************

2024-08-22T23:17:09,822   !!
2024-08-22T23:17:09,823     check.warn(importable)
2024-08-22T23:17:09,823   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-08-22T23:17:09,824   !!

2024-08-22T23:17:09,825           ********************************************************************************
2024-08-22T23:17:09,825           ############################
2024-08-22T23:17:09,827           # Package would be ignored #
2024-08-22T23:17:09,828           ############################
2024-08-22T23:17:09,829           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-08-22T23:17:09,829           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,831           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,832           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-08-22T23:17:09,832           to the `packages` configuration field.

2024-08-22T23:17:09,834           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,834           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,834           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,835           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,836           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,837           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-08-22T23:17:09,838           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-08-22T23:17:09,838           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,839           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,840           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,841           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,842           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,843           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,844                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,844                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,845                 directory, all directories are treated like packages.
2024-08-22T23:17:09,846           ********************************************************************************

2024-08-22T23:17:09,847   !!
2024-08-22T23:17:09,847     check.warn(importable)
2024-08-22T23:17:09,848   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-08-22T23:17:09,848   !!

2024-08-22T23:17:09,849           ********************************************************************************
2024-08-22T23:17:09,850           ############################
2024-08-22T23:17:09,851           # Package would be ignored #
2024-08-22T23:17:09,851           ############################
2024-08-22T23:17:09,852           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-08-22T23:17:09,852           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,853           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,854           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-08-22T23:17:09,854           to the `packages` configuration field.

2024-08-22T23:17:09,855           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,856           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,856           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,857           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,858           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,859           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-08-22T23:17:09,859           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-08-22T23:17:09,860           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,860           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,861           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,861           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,862           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,864           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,864                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,865                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,865                 directory, all directories are treated like packages.
2024-08-22T23:17:09,866           ********************************************************************************

2024-08-22T23:17:09,867   !!
2024-08-22T23:17:09,867     check.warn(importable)
2024-08-22T23:17:09,868   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-08-22T23:17:09,868   !!

2024-08-22T23:17:09,869           ********************************************************************************
2024-08-22T23:17:09,870           ############################
2024-08-22T23:17:09,870           # Package would be ignored #
2024-08-22T23:17:09,871           ############################
2024-08-22T23:17:09,871           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-08-22T23:17:09,872           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,873           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,874           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-08-22T23:17:09,874           to the `packages` configuration field.

2024-08-22T23:17:09,875           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,876           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,876           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,877           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,879           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,879           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-08-22T23:17:09,880           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-08-22T23:17:09,880           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,881           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,882           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,883           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,884           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,885           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,886                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,886                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,886                 directory, all directories are treated like packages.
2024-08-22T23:17:09,887           ********************************************************************************

2024-08-22T23:17:09,888   !!
2024-08-22T23:17:09,888     check.warn(importable)
2024-08-22T23:17:09,889   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-08-22T23:17:09,889   !!

2024-08-22T23:17:09,890           ********************************************************************************
2024-08-22T23:17:09,891           ############################
2024-08-22T23:17:09,891           # Package would be ignored #
2024-08-22T23:17:09,891           ############################
2024-08-22T23:17:09,892           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-08-22T23:17:09,892           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,893           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,894           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-08-22T23:17:09,894           to the `packages` configuration field.

2024-08-22T23:17:09,895           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,896           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,896           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,897           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,898           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,899           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-08-22T23:17:09,899           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-08-22T23:17:09,900           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,900           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,901           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,902           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,903           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,905           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,905                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,906                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,906                 directory, all directories are treated like packages.
2024-08-22T23:17:09,907           ********************************************************************************

2024-08-22T23:17:09,908   !!
2024-08-22T23:17:09,908     check.warn(importable)
2024-08-22T23:17:09,909   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-08-22T23:17:09,909   !!

2024-08-22T23:17:09,911           ********************************************************************************
2024-08-22T23:17:09,911           ############################
2024-08-22T23:17:09,912           # Package would be ignored #
2024-08-22T23:17:09,912           ############################
2024-08-22T23:17:09,913           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-08-22T23:17:09,913           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,914           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,915           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-08-22T23:17:09,915           to the `packages` configuration field.

2024-08-22T23:17:09,916           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,917           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,917           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,918           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,919           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,920           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-08-22T23:17:09,920           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-08-22T23:17:09,920           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,921           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,921           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,922           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,923           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,925           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,926                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,926                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,926                 directory, all directories are treated like packages.
2024-08-22T23:17:09,927           ********************************************************************************

2024-08-22T23:17:09,928   !!
2024-08-22T23:17:09,929     check.warn(importable)
2024-08-22T23:17:09,929   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-08-22T23:17:09,930   !!

2024-08-22T23:17:09,931           ********************************************************************************
2024-08-22T23:17:09,931           ############################
2024-08-22T23:17:09,932           # Package would be ignored #
2024-08-22T23:17:09,932           ############################
2024-08-22T23:17:09,933           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-08-22T23:17:09,933           but it is absent from setuptools' `packages` configuration.

2024-08-22T23:17:09,934           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-22T23:17:09,935           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-08-22T23:17:09,935           to the `packages` configuration field.

2024-08-22T23:17:09,936           Alternatively, you can also rely on setuptools' discovery methods
2024-08-22T23:17:09,937           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-22T23:17:09,937           instead of `find_packages(...)`/`find:`).

2024-08-22T23:17:09,939           You can read more about "package discovery" on setuptools documentation page:

2024-08-22T23:17:09,940           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-22T23:17:09,941           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-08-22T23:17:09,941           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-08-22T23:17:09,942           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-22T23:17:09,943           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-22T23:17:09,943           combination with a more fine grained `package-data` configuration.

2024-08-22T23:17:09,944           You can read more about "package data files" on setuptools documentation page:

2024-08-22T23:17:09,945           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-22T23:17:09,946           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-22T23:17:09,947                 even if it does not contain any `.py` files.
2024-08-22T23:17:09,947                 On the other hand, currently there is no concept of package data
2024-08-22T23:17:09,948                 directory, all directories are treated like packages.
2024-08-22T23:17:09,948           ********************************************************************************

2024-08-22T23:17:09,949   !!
2024-08-22T23:17:09,949     check.warn(importable)
2024-08-22T23:17:09,950   creating build/lib/deepspeed/autotuning/config_templates
2024-08-22T23:17:09,950   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-08-22T23:17:09,951   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-08-22T23:17:09,951   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-08-22T23:17:09,952   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-08-22T23:17:09,952   creating build/lib/deepspeed/ops/csrc
2024-08-22T23:17:09,952   creating build/lib/deepspeed/ops/csrc/adagrad
2024-08-22T23:17:09,953   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-08-22T23:17:09,953   creating build/lib/deepspeed/ops/csrc/adam
2024-08-22T23:17:09,954   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-08-22T23:17:09,954   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-08-22T23:17:09,955   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-08-22T23:17:09,955   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-08-22T23:17:09,956   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-08-22T23:17:09,956   creating build/lib/deepspeed/ops/csrc/aio
2024-08-22T23:17:09,957   creating build/lib/deepspeed/ops/csrc/aio/common
2024-08-22T23:17:09,957   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-22T23:17:09,958   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-22T23:17:09,958   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-22T23:17:09,959   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-22T23:17:09,959   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-22T23:17:09,960   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-22T23:17:09,960   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,961   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,961   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,962   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,963   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,963   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,964   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,964   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,964   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,965   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,966   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,966   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,967   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,967   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,968   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,968   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,969   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,969   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:09,970   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-08-22T23:17:09,970   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-08-22T23:17:09,971   creating build/lib/deepspeed/ops/csrc/cpu
2024-08-22T23:17:09,971   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-08-22T23:17:09,972   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-08-22T23:17:09,973   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:09,973   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:09,974   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:09,974   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:09,975   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:09,976   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-08-22T23:17:09,977   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-08-22T23:17:09,978   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-08-22T23:17:09,978   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:09,979   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:09,979   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:09,980   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:09,981   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:09,982   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:09,983   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:09,984   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:09,984   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:09,985   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:09,986   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:09,986   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:09,987   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:09,987   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:09,988   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:09,988   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:09,989   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:09,989   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:09,990   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:09,990   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:09,991   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:09,992   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:09,992   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:09,993   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:09,993   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:09,994   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:09,994   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:09,995   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:09,995   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-22T23:17:09,996   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-22T23:17:09,996   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-22T23:17:09,997   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-08-22T23:17:09,998   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-08-22T23:17:09,998   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-08-22T23:17:09,999   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-08-22T23:17:09,999   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-08-22T23:17:10,000   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-08-22T23:17:10,000   creating build/lib/deepspeed/ops/csrc/gds
2024-08-22T23:17:10,001   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:10,001   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:10,002   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:10,002   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:10,003   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:10,004   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:10,004   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:10,005   creating build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,006   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,006   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,007   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,008   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,009   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,010   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,010   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,011   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,012   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,013   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,014   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,014   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,015   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,016   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,017   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,018   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,018   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,019   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,020   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,021   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,022   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,022   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,023   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,023   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,024   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,025   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,025   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,026   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,027   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-22T23:17:10,027   creating build/lib/deepspeed/ops/csrc/lamb
2024-08-22T23:17:10,028   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-08-22T23:17:10,029   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-08-22T23:17:10,030   creating build/lib/deepspeed/ops/csrc/lion
2024-08-22T23:17:10,030   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-08-22T23:17:10,031   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-08-22T23:17:10,032   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-08-22T23:17:10,032   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-08-22T23:17:10,033   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-08-22T23:17:10,034   creating build/lib/deepspeed/ops/csrc/quantization
2024-08-22T23:17:10,034   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-22T23:17:10,035   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-22T23:17:10,036   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-08-22T23:17:10,036   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-22T23:17:10,037   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-22T23:17:10,040   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-22T23:17:10,043   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-22T23:17:10,046   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:10,048   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:10,051   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:10,054   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:10,057   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:10,060   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-08-22T23:17:10,062   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-08-22T23:17:10,065   creating build/lib/deepspeed/ops/csrc/spatial
2024-08-22T23:17:10,066   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-08-22T23:17:10,067   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-08-22T23:17:10,070   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-08-22T23:17:10,072   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-08-22T23:17:10,073   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-08-22T23:17:10,076   creating build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,077   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,080   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,084   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,088   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,091   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,094   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,099   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,103   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-22T23:17:10,106   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-08-22T23:17:10,107   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,108   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,111   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,114   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,119   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,122   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,125   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,130   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,133   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,136   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,140   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:10,143   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-08-22T23:17:10,145   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-08-22T23:17:10,148   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-08-22T23:17:10,152   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-08-22T23:17:10,155   creating build/lib/deepspeed/ops/csrc/utils
2024-08-22T23:17:10,157   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-08-22T23:17:10,160   creating build/lib/deepspeed/ops/csrc/xpu
2024-08-22T23:17:10,161   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-08-22T23:17:10,163   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-08-22T23:17:10,166   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-08-22T23:17:10,168   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-08-22T23:17:10,171   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-08-22T23:17:10,174   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-08-22T23:17:10,177   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-08-22T23:17:10,179   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-08-22T23:17:10,182   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:10,183   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:10,186   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:10,189   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:10,192   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:10,196   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:10,199   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-08-22T23:17:10,201   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-08-22T23:17:10,203   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-08-22T23:17:10,204   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-08-22T23:17:10,206   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-08-22T23:17:10,208   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-08-22T23:17:10,209   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-08-22T23:17:10,211   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:10,212   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:10,215   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:10,217   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:10,219   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:10,222   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:10,225   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-08-22T23:17:10,227   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-08-22T23:17:10,228   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-08-22T23:17:10,230   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-08-22T23:17:10,232   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-08-22T23:17:10,234   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-08-22T23:17:10,235   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-08-22T23:17:10,238   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-22T23:17:10,238   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-22T23:17:10,240   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-22T23:17:10,242   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-22T23:17:10,244   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:10,246   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:10,248   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:10,250   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:10,252   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:10,254   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:10,256   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:10,259   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:10,261   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:10,263   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:10,265   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:10,267   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:10,270   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:10,272   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:10,275   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:10,278   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:10,281   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:10,283   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:10,285   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:10,288   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:10,290   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:10,293   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:10,295   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:10,297   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:10,299   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,300   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,302   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,305   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,307   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,309   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,311   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,314   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,316   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,318   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:10,320   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:10,323   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:10,325   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:10,326   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:10,329   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:10,331   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:10,333   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:10,335   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:10,337   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:10,339   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:10,341   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:10,343   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:10,345   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:10,347   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:10,349   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:10,352   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:10,353   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:10,355   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:10,358   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:10,360   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:10,363   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:10,365   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:10,368   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:10,370   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:10,372   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:10,374   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:10,376   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:10,379   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:10,380   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:10,382   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:10,384   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:10,387   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:10,389   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:10,439   running build_scripts
2024-08-22T23:17:10,440   creating build/scripts-3.11
2024-08-22T23:17:10,441   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-08-22T23:17:10,442   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-08-22T23:17:10,444   copying and adjusting bin/ds -> build/scripts-3.11
2024-08-22T23:17:10,445   copying bin/ds_ssh -> build/scripts-3.11
2024-08-22T23:17:10,447   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-08-22T23:17:10,448   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-08-22T23:17:10,450   copying and adjusting bin/dsr -> build/scripts-3.11
2024-08-22T23:17:10,451   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-08-22T23:17:10,452   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-08-22T23:17:10,453   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-08-22T23:17:10,453   changing mode of build/scripts-3.11/ds from 644 to 755
2024-08-22T23:17:10,454   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-08-22T23:17:10,454   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-08-22T23:17:10,455   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-08-22T23:17:10,455   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-08-22T23:17:10,482   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-08-22T23:17:10,483   !!

2024-08-22T23:17:10,484           ********************************************************************************
2024-08-22T23:17:10,484           Please avoid running ``setup.py`` directly.
2024-08-22T23:17:10,485           Instead, use pypa/build, pypa/installer or other
2024-08-22T23:17:10,486           standards-based tools.

2024-08-22T23:17:10,487           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-08-22T23:17:10,487           ********************************************************************************

2024-08-22T23:17:10,489   !!
2024-08-22T23:17:10,489     self.initialize_options()
2024-08-22T23:17:10,509   installing to build/bdist.linux-armv7l/wheel
2024-08-22T23:17:10,510   running install
2024-08-22T23:17:10,534   running install_lib
2024-08-22T23:17:10,560   creating build/bdist.linux-armv7l
2024-08-22T23:17:10,561   creating build/bdist.linux-armv7l/wheel
2024-08-22T23:17:10,563   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-08-22T23:17:10,564   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-08-22T23:17:10,565   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-22T23:17:10,568   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-22T23:17:10,570   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-22T23:17:10,573   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-08-22T23:17:10,574   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-08-22T23:17:10,575   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-08-22T23:17:10,578   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-08-22T23:17:10,579   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-08-22T23:17:10,581   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-22T23:17:10,583   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-08-22T23:17:10,584   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-22T23:17:10,586   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-22T23:17:10,588   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-22T23:17:10,590   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-22T23:17:10,591   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-22T23:17:10,593   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-22T23:17:10,595   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-22T23:17:10,598   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-22T23:17:10,600   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-08-22T23:17:10,601   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-22T23:17:10,603   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-22T23:17:10,605   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-22T23:17:10,607   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-22T23:17:10,609   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-22T23:17:10,610   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-22T23:17:10,614   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-08-22T23:17:10,615   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-08-22T23:17:10,616   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,618   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,620   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,621   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,623   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,625   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,627   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,629   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,631   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,632   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-22T23:17:10,635   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-08-22T23:17:10,636   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-08-22T23:17:10,638   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-08-22T23:17:10,640   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-08-22T23:17:10,640   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-08-22T23:17:10,642   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-08-22T23:17:10,644   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-08-22T23:17:10,646   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-08-22T23:17:10,647   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-22T23:17:10,650   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-08-22T23:17:10,651   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,653   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,655   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,657   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,659   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,660   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,662   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,664   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,667   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,668   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,670   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,673   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,675   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,677   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,679   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,681   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,684   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,686   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-22T23:17:10,688   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-08-22T23:17:10,689   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,691   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,693   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,695   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,698   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,700   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,702   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,704   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,705   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,708   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-22T23:17:10,711   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-08-22T23:17:10,711   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,714   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,717   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,719   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,721   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,724   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,726   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-08-22T23:17:10,727   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-08-22T23:17:10,729   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-08-22T23:17:10,732   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-08-22T23:17:10,734   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,737   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-08-22T23:17:10,738   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-08-22T23:17:10,740   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:10,741   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:10,743   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:10,745   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:10,747   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:10,749   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-22T23:17:10,752   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:10,753   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:10,755   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:10,758   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:10,761   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:10,763   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-22T23:17:10,765   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-08-22T23:17:10,767   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-08-22T23:17:10,769   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-08-22T23:17:10,771   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,773   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,775   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-08-22T23:17:10,775   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-22T23:17:10,778   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-22T23:17:10,780   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-22T23:17:10,783   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-22T23:17:10,785   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-22T23:17:10,787   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-22T23:17:10,789   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,792   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-08-22T23:17:10,793   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-08-22T23:17:10,795   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-08-22T23:17:10,797   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-08-22T23:17:10,798   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-08-22T23:17:10,800   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-08-22T23:17:10,802   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-08-22T23:17:10,804   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-08-22T23:17:10,806   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-08-22T23:17:10,808   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-08-22T23:17:10,811   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-08-22T23:17:10,813   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-08-22T23:17:10,816   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-08-22T23:17:10,818   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,820   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,825   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-08-22T23:17:10,826   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,828   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,830   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,835   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,836   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,838   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,842   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,847   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,849   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,851   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,854   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,856   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,859   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,861   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,864   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,866   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-22T23:17:10,869   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,871   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,873   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-08-22T23:17:10,874   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-22T23:17:10,877   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-22T23:17:10,880   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-22T23:17:10,882   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-22T23:17:10,885   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-22T23:17:10,888   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-22T23:17:10,890   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,893   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:10,894   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:10,896   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:10,898   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:10,900   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-08-22T23:17:10,902   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,903   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,905   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,908   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,910   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,912   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,915   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,916   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,918   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,920   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-22T23:17:10,923   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,926   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,928   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-22T23:17:10,932   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-08-22T23:17:10,933   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,935   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,938   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,940   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,942   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,944   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,946   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,948   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,950   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-22T23:17:10,952   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-08-22T23:17:10,953   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,955   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,957   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,959   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,961   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,963   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,966   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,967   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,970   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,971   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,974   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,977   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,979   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-22T23:17:10,982   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-08-22T23:17:10,983   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:10,985   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:10,987   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:10,990   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:10,991   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:10,994   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-08-22T23:17:10,995   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-22T23:17:10,997   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-22T23:17:10,999   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-22T23:17:11,002   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-22T23:17:11,003   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-22T23:17:11,005   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-22T23:17:11,008   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-22T23:17:11,010   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,013   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,015   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,016   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,019   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,020   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,022   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,024   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,026   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,028   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,030   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,032   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,034   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,036   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-22T23:17:11,039   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-08-22T23:17:11,040   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-22T23:17:11,042   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-22T23:17:11,044   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-22T23:17:11,046   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-22T23:17:11,049   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-22T23:17:11,051   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-22T23:17:11,052   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-22T23:17:11,055   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-22T23:17:11,059   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-08-22T23:17:11,060   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-22T23:17:11,062   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-22T23:17:11,063   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-22T23:17:11,065   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-22T23:17:11,067   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-22T23:17:11,069   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-22T23:17:11,070   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-22T23:17:11,072   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-22T23:17:11,074   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-08-22T23:17:11,075   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-08-22T23:17:11,077   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-08-22T23:17:11,079   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-08-22T23:17:11,081   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-22T23:17:11,084   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-08-22T23:17:11,085   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,087   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,089   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,092   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,094   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,095   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,098   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,100   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,102   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-22T23:17:11,105   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-08-22T23:17:11,106   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-08-22T23:17:11,108   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-08-22T23:17:11,110   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-08-22T23:17:11,111   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-08-22T23:17:11,114   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-08-22T23:17:11,116   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-08-22T23:17:11,119   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-08-22T23:17:11,120   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-08-22T23:17:11,122   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-08-22T23:17:11,123   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-22T23:17:11,125   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-22T23:17:11,127   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-22T23:17:11,129   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-22T23:17:11,132   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-22T23:17:11,133   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-22T23:17:11,136   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-22T23:17:11,138   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-22T23:17:11,140   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-08-22T23:17:11,141   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-08-22T23:17:11,142   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-22T23:17:11,145   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-22T23:17:11,147   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-22T23:17:11,149   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-22T23:17:11,151   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-22T23:17:11,152   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-08-22T23:17:11,154   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-08-22T23:17:11,158   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-08-22T23:17:11,159   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-08-22T23:17:11,160   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-22T23:17:11,163   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-22T23:17:11,165   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-22T23:17:11,168   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:11,169   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:11,170   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:11,172   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:11,174   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-08-22T23:17:11,177   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,178   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,180   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,182   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,184   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,186   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,188   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,190   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,192   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,193   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-22T23:17:11,196   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:11,197   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:11,199   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:11,200   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:11,203   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-08-22T23:17:11,204   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-22T23:17:11,207   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:11,208   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:11,210   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:11,211   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:11,213   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-08-22T23:17:11,216   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:11,217   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:11,219   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:11,221   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:11,223   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-08-22T23:17:11,225   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-22T23:17:11,228   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:11,228   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:11,230   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:11,232   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:11,234   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-22T23:17:11,236   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-22T23:17:11,239   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:11,240   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:11,242   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:11,243   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:11,246   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-08-22T23:17:11,248   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:11,249   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:11,251   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:11,252   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:11,254   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-08-22T23:17:11,257   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-22T23:17:11,259   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:11,260   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:11,263   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:11,264   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:11,267   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-08-22T23:17:11,270   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:11,271   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:11,272   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:11,274   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:11,276   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-08-22T23:17:11,279   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:11,280   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:11,282   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:11,283   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:11,285   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-22T23:17:11,288   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,289   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,291   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,292   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,294   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,296   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,298   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,300   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,302   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,304   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-22T23:17:11,306   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-08-22T23:17:11,307   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-08-22T23:17:11,310   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-08-22T23:17:11,311   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-08-22T23:17:11,313   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-08-22T23:17:11,316   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-08-22T23:17:11,316   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-22T23:17:11,319   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-22T23:17:11,320   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-22T23:17:11,323   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-22T23:17:11,325   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-22T23:17:11,328   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-22T23:17:11,331   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-08-22T23:17:11,332   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-08-22T23:17:11,334   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-08-22T23:17:11,336   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-08-22T23:17:11,338   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-08-22T23:17:11,340   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-22T23:17:11,343   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-08-22T23:17:11,344   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-08-22T23:17:11,346   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-08-22T23:17:11,349   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-08-22T23:17:11,350   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-08-22T23:17:11,352   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-08-22T23:17:11,355   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:11,356   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:11,358   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:11,360   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:11,363   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:11,365   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-22T23:17:11,367   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-08-22T23:17:11,369   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-08-22T23:17:11,371   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:11,372   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:11,375   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:11,377   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:11,379   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:11,381   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:11,384   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-22T23:17:11,386   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:11,388   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:11,391   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:11,393   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:11,396   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:11,398   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-22T23:17:11,401   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-08-22T23:17:11,403   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:11,404   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:11,406   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:11,409   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:11,411   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:11,413   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-22T23:17:11,416   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:11,417   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:11,420   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:11,422   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:11,424   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:11,426   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:11,428   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:11,430   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-22T23:17:11,432   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-08-22T23:17:11,434   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-08-22T23:17:11,436   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,438   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,440   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,442   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,444   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,447   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,449   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,451   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,453   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-22T23:17:11,456   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:11,457   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:11,459   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:11,461   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:11,464   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:11,466   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-22T23:17:11,468   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:11,470   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:11,473   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:11,475   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:11,478   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-22T23:17:11,480   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:11,482   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:11,485   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,486   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,489   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,492   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,494   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,496   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,499   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,501   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,504   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,506   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-22T23:17:11,509   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:11,511   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:11,513   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:11,516   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:11,519   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-22T23:17:11,521   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-08-22T23:17:11,523   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:11,524   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:11,526   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:11,529   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:11,531   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:11,533   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:11,536   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-22T23:17:11,539   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:11,540   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:11,542   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:11,544   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:11,546   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-22T23:17:11,549   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-08-22T23:17:11,551   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:11,552   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:11,555   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:11,557   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:11,559   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:11,561   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:11,563   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-22T23:17:11,565   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:11,566   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:11,568   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:11,570   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:11,572   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:11,574   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:11,576   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-22T23:17:11,579   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-22T23:17:11,580   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-22T23:17:11,582   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-22T23:17:11,584   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-22T23:17:11,586   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-08-22T23:17:11,587   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-08-22T23:17:11,589   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:11,590   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:11,593   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:11,595   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:11,596   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:11,598   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:11,600   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-22T23:17:11,602   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,603   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,605   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,607   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,609   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,611   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,615   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,618   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,621   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-22T23:17:11,623   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-08-22T23:17:11,626   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:11,628   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:11,630   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:11,633   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:11,636   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:11,638   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:11,641   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-22T23:17:11,644   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:11,645   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:11,648   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:11,650   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:11,653   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:11,655   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:11,658   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-22T23:17:11,661   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,665   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,667   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,669   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,672   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,674   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,677   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,680   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-08-22T23:17:11,682   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,683   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,686   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,689   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,691   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,693   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,696   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,698   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,701   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-22T23:17:11,704   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-08-22T23:17:11,706   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-08-22T23:17:11,707   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-08-22T23:17:11,710   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-08-22T23:17:11,713   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-08-22T23:17:11,714   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-08-22T23:17:11,715   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-08-22T23:17:11,718   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-08-22T23:17:11,719   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-08-22T23:17:11,721   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-08-22T23:17:11,723   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-08-22T23:17:11,725   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-22T23:17:11,726   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-22T23:17:11,728   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-22T23:17:11,730   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-22T23:17:11,732   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-08-22T23:17:11,733   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-08-22T23:17:11,735   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-08-22T23:17:11,738   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-08-22T23:17:11,739   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-08-22T23:17:11,741   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-08-22T23:17:11,743   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-08-22T23:17:11,745   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-08-22T23:17:11,746   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-08-22T23:17:11,748   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-08-22T23:17:11,750   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-08-22T23:17:11,752   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-08-22T23:17:11,754   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-08-22T23:17:11,757   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-08-22T23:17:11,758   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-22T23:17:11,760   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-22T23:17:11,761   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-22T23:17:11,763   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-22T23:17:11,765   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-22T23:17:11,767   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-22T23:17:11,768   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-22T23:17:11,771   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-08-22T23:17:11,772   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,779   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-22T23:17:11,781   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-08-22T23:17:11,784   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-08-22T23:17:11,784   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-08-22T23:17:11,787   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-08-22T23:17:11,788   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-08-22T23:17:11,791   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-08-22T23:17:11,792   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-22T23:17:11,794   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-22T23:17:11,796   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-22T23:17:11,798   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-22T23:17:11,800   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-22T23:17:11,802   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-08-22T23:17:11,803   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-22T23:17:11,805   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-22T23:17:11,807   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-22T23:17:11,810   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-22T23:17:11,812   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-22T23:17:11,814   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-22T23:17:11,817   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-08-22T23:17:11,818   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-08-22T23:17:11,819   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-08-22T23:17:11,821   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-08-22T23:17:11,823   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-08-22T23:17:11,824   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-08-22T23:17:11,826   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-08-22T23:17:11,828   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-08-22T23:17:11,831   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-08-22T23:17:11,832   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-08-22T23:17:11,834   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-08-22T23:17:11,836   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-08-22T23:17:11,838   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-08-22T23:17:11,841   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-08-22T23:17:11,842   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-08-22T23:17:11,844   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-08-22T23:17:11,846   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-08-22T23:17:11,848   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-08-22T23:17:11,850   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-08-22T23:17:11,851   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-22T23:17:11,855   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:11,856   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:11,858   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:11,860   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:11,861   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-08-22T23:17:11,863   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-22T23:17:11,865   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-22T23:17:11,867   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-22T23:17:11,870   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-22T23:17:11,872   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-22T23:17:11,875   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-22T23:17:11,878   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-08-22T23:17:11,878   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-08-22T23:17:11,880   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-08-22T23:17:11,883   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-08-22T23:17:11,884   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-08-22T23:17:11,886   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-08-22T23:17:11,888   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-08-22T23:17:11,889   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-08-22T23:17:11,891   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-08-22T23:17:11,893   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-08-22T23:17:11,896   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-08-22T23:17:11,897   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-08-22T23:17:11,899   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-08-22T23:17:11,901   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:11,902   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:11,905   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:11,907   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:11,910   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-08-22T23:17:11,913   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-08-22T23:17:11,914   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-08-22T23:17:11,916   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-08-22T23:17:11,919   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-08-22T23:17:11,920   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-08-22T23:17:11,922   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-08-22T23:17:11,925   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-08-22T23:17:11,926   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-08-22T23:17:11,928   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-08-22T23:17:11,929   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-22T23:17:11,931   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-22T23:17:11,934   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-22T23:17:11,935   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-22T23:17:11,937   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-22T23:17:11,940   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-08-22T23:17:11,941   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-22T23:17:11,944   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-22T23:17:11,946   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-22T23:17:11,948   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-22T23:17:11,950   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-22T23:17:11,953   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-08-22T23:17:11,954   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-08-22T23:17:11,957   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-08-22T23:17:11,958   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-08-22T23:17:11,961   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-08-22T23:17:11,962   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-22T23:17:11,965   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-22T23:17:11,967   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-22T23:17:11,970   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-22T23:17:11,973   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-22T23:17:11,976   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-22T23:17:11,978   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-22T23:17:11,981   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-08-22T23:17:11,983   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-08-22T23:17:11,986   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-08-22T23:17:11,989   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-08-22T23:17:11,990   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-08-22T23:17:11,991   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-08-22T23:17:11,994   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-08-22T23:17:11,995   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-08-22T23:17:11,998   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-08-22T23:17:12,000   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-08-22T23:17:12,003   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-08-22T23:17:12,004   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-08-22T23:17:12,007   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-08-22T23:17:12,009   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-08-22T23:17:12,011   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:12,013   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:12,015   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:12,017   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:12,020   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:12,022   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-22T23:17:12,025   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-08-22T23:17:12,026   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-08-22T23:17:12,028   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-08-22T23:17:12,030   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-08-22T23:17:12,031   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-08-22T23:17:12,034   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:12,035   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:12,038   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:12,041   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:12,043   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-08-22T23:17:12,046   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-08-22T23:17:12,048   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,050   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,052   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,055   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,056   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,059   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,061   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,063   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,065   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,067   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,070   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,072   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,074   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,076   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,078   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,080   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,082   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,084   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-22T23:17:12,087   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-08-22T23:17:12,088   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-22T23:17:12,090   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-22T23:17:12,093   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-22T23:17:12,096   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-22T23:17:12,098   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-22T23:17:12,100   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-22T23:17:12,102   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-08-22T23:17:12,104   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-08-22T23:17:12,107   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-08-22T23:17:12,108   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,111   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,114   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,117   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,119   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,122   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,124   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,126   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,129   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,131   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,133   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,135   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,138   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,140   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,142   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,144   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,146   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,148   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,152   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,154   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,156   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,159   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,162   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,164   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,167   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,170   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,173   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,175   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,178   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-22T23:17:12,180   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2024-08-22T23:17:12,182   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:12,183   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:12,186   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:12,188   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:12,190   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:12,192   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:12,195   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-08-22T23:17:12,198   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,199   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,202   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,205   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,208   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,211   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,214   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,217   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-08-22T23:17:12,219   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,220   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,222   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,226   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,228   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,230   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,233   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,236   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,238   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,242   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,244   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-22T23:17:12,247   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-08-22T23:17:12,248   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-08-22T23:17:12,250   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-08-22T23:17:12,253   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-08-22T23:17:12,255   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,258   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-22T23:17:12,262   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-08-22T23:17:12,263   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:12,264   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:12,269   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:12,269   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:12,272   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:12,274   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:12,277   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-22T23:17:12,279   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:12,282   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:12,284   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:12,287   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:12,288   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:12,291   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:12,293   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:12,296   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:12,299   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:12,301   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:12,303   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-22T23:17:12,306   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:12,309   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-22T23:17:12,311   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:12,312   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:12,315   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:12,318   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:12,320   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:12,322   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:12,326   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:12,328   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-22T23:17:12,331   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-22T23:17:12,332   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-22T23:17:12,334   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-22T23:17:12,337   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-08-22T23:17:12,339   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-08-22T23:17:12,340   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-08-22T23:17:12,342   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-08-22T23:17:12,344   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-08-22T23:17:12,345   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-08-22T23:17:12,348   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2024-08-22T23:17:12,349   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2024-08-22T23:17:12,351   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-08-22T23:17:12,352   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-08-22T23:17:12,355   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-08-22T23:17:12,357   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-08-22T23:17:12,358   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,360   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,361   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,364   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,365   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,368   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,370   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,372   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,375   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,376   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,379   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,381   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,383   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,385   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-22T23:17:12,388   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,389   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,391   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,393   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,395   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,397   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,399   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,400   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,403   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,404   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,406   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-22T23:17:12,408   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,410   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,412   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,414   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,416   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,418   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,421   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-22T23:17:12,424   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-08-22T23:17:12,425   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-08-22T23:17:12,427   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-08-22T23:17:12,431   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-08-22T23:17:12,432   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,435   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,437   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,439   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,441   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,444   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,446   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,448   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,450   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,452   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,454   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,457   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,458   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,461   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,463   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,465   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,468   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,470   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,472   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,474   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,476   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-22T23:17:12,478   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,480   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,482   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,484   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,487   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,489   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,491   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,494   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,495   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,498   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,500   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,502   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,504   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,507   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,509   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,511   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,513   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,515   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-22T23:17:12,518   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,520   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-08-22T23:17:12,521   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-22T23:17:12,523   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-22T23:17:12,525   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-22T23:17:12,527   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-22T23:17:12,528   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-22T23:17:12,530   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-22T23:17:12,532   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,534   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,536   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,539   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-08-22T23:17:12,540   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-22T23:17:12,542   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-22T23:17:12,544   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-22T23:17:12,545   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-22T23:17:12,547   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-22T23:17:12,549   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,551   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-22T23:17:12,553   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-22T23:17:12,554   running install_egg_info
2024-08-22T23:17:12,589   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.15.0-py3.11.egg-info
2024-08-22T23:17:12,603   running install_scripts
2024-08-22T23:17:12,604   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data
2024-08-22T23:17:12,604   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,606   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,608   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,610   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,612   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,614   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,615   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,617   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,619   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts
2024-08-22T23:17:12,620   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts/ds_report to 755
2024-08-22T23:17:12,620   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts/ds to 755
2024-08-22T23:17:12,621   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts/ds_elastic to 755
2024-08-22T23:17:12,622   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts/ds_bench to 755
2024-08-22T23:17:12,622   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts/deepspeed.pt to 755
2024-08-22T23:17:12,623   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts/dsr to 755
2024-08-22T23:17:12,623   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts/ds_ssh to 755
2024-08-22T23:17:12,623   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.data/scripts/deepspeed to 755
2024-08-22T23:17:12,670   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.0.dist-info/WHEEL
2024-08-22T23:17:12,673   creating '/tmp/pip-wheel-x167tbwj/deepspeed-0.15.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-08-22T23:17:12,676   adding 'deepspeed/__init__.py'
2024-08-22T23:17:12,678   adding 'deepspeed/constants.py'
2024-08-22T23:17:12,680   adding 'deepspeed/env_report.py'
2024-08-22T23:17:12,681   adding 'deepspeed/git_version_info.py'
2024-08-22T23:17:12,682   adding 'deepspeed/git_version_info_installed.py'
2024-08-22T23:17:12,684   adding 'deepspeed/accelerator/__init__.py'
2024-08-22T23:17:12,685   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-08-22T23:17:12,687   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-08-22T23:17:12,689   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-08-22T23:17:12,692   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-08-22T23:17:12,693   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-08-22T23:17:12,695   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-08-22T23:17:12,697   adding 'deepspeed/accelerator/real_accelerator.py'
2024-08-22T23:17:12,699   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-08-22T23:17:12,700   adding 'deepspeed/autotuning/__init__.py'
2024-08-22T23:17:12,706   adding 'deepspeed/autotuning/autotuner.py'
2024-08-22T23:17:12,707   adding 'deepspeed/autotuning/config.py'
2024-08-22T23:17:12,709   adding 'deepspeed/autotuning/constants.py'
2024-08-22T23:17:12,711   adding 'deepspeed/autotuning/scheduler.py'
2024-08-22T23:17:12,714   adding 'deepspeed/autotuning/utils.py'
2024-08-22T23:17:12,716   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-08-22T23:17:12,717   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-08-22T23:17:12,719   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-08-22T23:17:12,720   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-08-22T23:17:12,722   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-08-22T23:17:12,723   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-08-22T23:17:12,725   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-08-22T23:17:12,726   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-08-22T23:17:12,728   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-08-22T23:17:12,729   adding 'deepspeed/autotuning/tuner/utils.py'
2024-08-22T23:17:12,731   adding 'deepspeed/checkpoint/__init__.py'
2024-08-22T23:17:12,733   adding 'deepspeed/checkpoint/constants.py'
2024-08-22T23:17:12,735   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-08-22T23:17:12,738   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-08-22T23:17:12,739   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-08-22T23:17:12,741   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-08-22T23:17:12,742   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-08-22T23:17:12,744   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-08-22T23:17:12,745   adding 'deepspeed/checkpoint/utils.py'
2024-08-22T23:17:12,746   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-08-22T23:17:12,748   adding 'deepspeed/comm/__init__.py'
2024-08-22T23:17:12,749   adding 'deepspeed/comm/backend.py'
2024-08-22T23:17:12,751   adding 'deepspeed/comm/ccl.py'
2024-08-22T23:17:12,754   adding 'deepspeed/comm/comm.py'
2024-08-22T23:17:12,755   adding 'deepspeed/comm/config.py'
2024-08-22T23:17:12,756   adding 'deepspeed/comm/constants.py'
2024-08-22T23:17:12,757   adding 'deepspeed/comm/reduce_op.py'
2024-08-22T23:17:12,760   adding 'deepspeed/comm/torch.py'
2024-08-22T23:17:12,761   adding 'deepspeed/comm/utils.py'
2024-08-22T23:17:12,763   adding 'deepspeed/compression/__init__.py'
2024-08-22T23:17:12,766   adding 'deepspeed/compression/basic_layer.py'
2024-08-22T23:17:12,768   adding 'deepspeed/compression/compress.py'
2024-08-22T23:17:12,770   adding 'deepspeed/compression/config.py'
2024-08-22T23:17:12,771   adding 'deepspeed/compression/constants.py'
2024-08-22T23:17:12,773   adding 'deepspeed/compression/helper.py'
2024-08-22T23:17:12,775   adding 'deepspeed/compression/scheduler.py'
2024-08-22T23:17:12,776   adding 'deepspeed/compression/utils.py'
2024-08-22T23:17:12,778   adding 'deepspeed/elasticity/__init__.py'
2024-08-22T23:17:12,779   adding 'deepspeed/elasticity/config.py'
2024-08-22T23:17:12,781   adding 'deepspeed/elasticity/constants.py'
2024-08-22T23:17:12,782   adding 'deepspeed/elasticity/elastic_agent.py'
2024-08-22T23:17:12,785   adding 'deepspeed/elasticity/elasticity.py'
2024-08-22T23:17:12,786   adding 'deepspeed/elasticity/utils.py'
2024-08-22T23:17:12,788   adding 'deepspeed/inference/__init__.py'
2024-08-22T23:17:12,790   adding 'deepspeed/inference/config.py'
2024-08-22T23:17:12,793   adding 'deepspeed/inference/engine.py'
2024-08-22T23:17:12,795   adding 'deepspeed/inference/quantization/__init__.py'
2024-08-22T23:17:12,796   adding 'deepspeed/inference/quantization/layers.py'
2024-08-22T23:17:12,798   adding 'deepspeed/inference/quantization/quantization.py'
2024-08-22T23:17:12,803   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-08-22T23:17:12,805   adding 'deepspeed/inference/quantization/utils.py'
2024-08-22T23:17:12,807   adding 'deepspeed/inference/v2/__init__.py'
2024-08-22T23:17:12,808   adding 'deepspeed/inference/v2/allocator.py'
2024-08-22T23:17:12,809   adding 'deepspeed/inference/v2/config_v2.py'
2024-08-22T23:17:12,811   adding 'deepspeed/inference/v2/engine_factory.py'
2024-08-22T23:17:12,813   adding 'deepspeed/inference/v2/engine_v2.py'
2024-08-22T23:17:12,814   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-08-22T23:17:12,816   adding 'deepspeed/inference/v2/inference_utils.py'
2024-08-22T23:17:12,817   adding 'deepspeed/inference/v2/logging.py'
2024-08-22T23:17:12,818   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-08-22T23:17:12,820   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-08-22T23:17:12,821   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-08-22T23:17:12,823   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-08-22T23:17:12,824   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-08-22T23:17:12,826   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-08-22T23:17:12,827   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-08-22T23:17:12,829   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-08-22T23:17:12,830   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-08-22T23:17:12,832   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-08-22T23:17:12,833   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-08-22T23:17:12,834   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-08-22T23:17:12,835   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-08-22T23:17:12,837   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-08-22T23:17:12,838   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-08-22T23:17:12,840   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-08-22T23:17:12,841   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-08-22T23:17:12,842   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-08-22T23:17:12,844   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-08-22T23:17:12,845   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-08-22T23:17:12,846   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-08-22T23:17:12,848   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-08-22T23:17:12,849   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-08-22T23:17:12,850   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-08-22T23:17:12,851   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-08-22T23:17:12,853   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-08-22T23:17:12,855   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-08-22T23:17:12,856   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-08-22T23:17:12,858   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-08-22T23:17:12,860   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-08-22T23:17:12,861   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-08-22T23:17:12,863   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-08-22T23:17:12,865   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-08-22T23:17:12,867   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-08-22T23:17:12,868   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-08-22T23:17:12,869   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-08-22T23:17:12,871   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-08-22T23:17:12,872   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-08-22T23:17:12,874   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-08-22T23:17:12,875   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-08-22T23:17:12,877   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-08-22T23:17:12,879   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-08-22T23:17:12,880   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-08-22T23:17:12,881   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-08-22T23:17:12,882   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-08-22T23:17:12,884   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-08-22T23:17:12,885   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-08-22T23:17:12,887   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-08-22T23:17:12,888   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-08-22T23:17:12,889   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-08-22T23:17:12,891   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-08-22T23:17:12,892   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-08-22T23:17:12,893   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-08-22T23:17:12,895   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-08-22T23:17:12,896   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-08-22T23:17:12,897   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-08-22T23:17:12,899   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-08-22T23:17:12,900   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-08-22T23:17:12,901   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-08-22T23:17:12,902   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-08-22T23:17:12,904   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-08-22T23:17:12,905   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-08-22T23:17:12,907   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-08-22T23:17:12,908   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-08-22T23:17:12,909   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-08-22T23:17:12,910   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-08-22T23:17:12,912   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-08-22T23:17:12,914   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-08-22T23:17:12,916   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-08-22T23:17:12,917   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-08-22T23:17:12,919   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-08-22T23:17:12,922   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-08-22T23:17:12,924   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-08-22T23:17:12,925   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-08-22T23:17:12,927   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-08-22T23:17:12,928   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-08-22T23:17:12,929   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-08-22T23:17:12,931   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-08-22T23:17:12,932   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-08-22T23:17:12,934   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-08-22T23:17:12,935   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-08-22T23:17:12,937   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-08-22T23:17:12,938   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-08-22T23:17:12,940   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-08-22T23:17:12,941   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-08-22T23:17:12,943   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-08-22T23:17:12,944   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-08-22T23:17:12,945   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-08-22T23:17:12,946   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-08-22T23:17:12,948   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-08-22T23:17:12,949   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-08-22T23:17:12,951   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-08-22T23:17:12,953   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-08-22T23:17:12,954   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-08-22T23:17:12,955   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-08-22T23:17:12,956   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-08-22T23:17:12,958   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-08-22T23:17:12,960   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-08-22T23:17:12,961   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-08-22T23:17:12,963   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-08-22T23:17:12,964   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-08-22T23:17:12,965   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-08-22T23:17:12,966   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-08-22T23:17:12,967   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-08-22T23:17:12,969   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-08-22T23:17:12,971   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-08-22T23:17:12,972   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-08-22T23:17:12,973   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-08-22T23:17:12,974   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-08-22T23:17:12,975   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-08-22T23:17:12,977   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-08-22T23:17:12,979   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-08-22T23:17:12,980   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-08-22T23:17:12,981   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-08-22T23:17:12,982   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-08-22T23:17:12,984   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-08-22T23:17:12,985   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-08-22T23:17:12,987   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-08-22T23:17:12,988   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-08-22T23:17:12,989   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-08-22T23:17:12,991   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-08-22T23:17:12,992   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-08-22T23:17:12,993   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-08-22T23:17:12,995   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-08-22T23:17:12,996   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-08-22T23:17:12,997   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-08-22T23:17:12,999   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-08-22T23:17:13,001   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-08-22T23:17:13,003   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-08-22T23:17:13,004   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-08-22T23:17:13,007   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-08-22T23:17:13,009   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-08-22T23:17:13,011   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-08-22T23:17:13,012   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-08-22T23:17:13,013   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-08-22T23:17:13,014   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-08-22T23:17:13,016   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-08-22T23:17:13,017   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-08-22T23:17:13,018   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-08-22T23:17:13,019   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-08-22T23:17:13,021   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-08-22T23:17:13,022   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-08-22T23:17:13,024   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-08-22T23:17:13,025   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-08-22T23:17:13,026   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-08-22T23:17:13,028   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-08-22T23:17:13,030   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-08-22T23:17:13,031   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-08-22T23:17:13,032   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-08-22T23:17:13,034   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-08-22T23:17:13,035   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-08-22T23:17:13,037   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-08-22T23:17:13,039   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-08-22T23:17:13,040   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-08-22T23:17:13,041   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-08-22T23:17:13,043   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-08-22T23:17:13,044   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-08-22T23:17:13,045   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-08-22T23:17:13,047   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-08-22T23:17:13,048   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-08-22T23:17:13,050   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-08-22T23:17:13,051   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-08-22T23:17:13,053   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-08-22T23:17:13,054   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-08-22T23:17:13,056   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-08-22T23:17:13,057   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-08-22T23:17:13,059   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-08-22T23:17:13,060   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-08-22T23:17:13,061   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-08-22T23:17:13,062   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-08-22T23:17:13,064   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-08-22T23:17:13,065   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-08-22T23:17:13,066   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-08-22T23:17:13,068   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-08-22T23:17:13,069   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-08-22T23:17:13,070   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-08-22T23:17:13,072   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-08-22T23:17:13,073   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-08-22T23:17:13,075   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-08-22T23:17:13,076   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-08-22T23:17:13,078   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-08-22T23:17:13,079   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-08-22T23:17:13,081   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-08-22T23:17:13,082   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-08-22T23:17:13,084   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-08-22T23:17:13,085   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-08-22T23:17:13,086   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-08-22T23:17:13,088   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-08-22T23:17:13,089   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-08-22T23:17:13,090   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-08-22T23:17:13,092   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-08-22T23:17:13,094   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-08-22T23:17:13,095   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-08-22T23:17:13,096   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-08-22T23:17:13,098   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-08-22T23:17:13,100   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-08-22T23:17:13,101   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-08-22T23:17:13,102   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-08-22T23:17:13,104   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-08-22T23:17:13,105   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-08-22T23:17:13,106   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-08-22T23:17:13,107   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-08-22T23:17:13,109   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-08-22T23:17:13,111   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-08-22T23:17:13,112   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-08-22T23:17:13,114   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-08-22T23:17:13,115   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-08-22T23:17:13,117   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-08-22T23:17:13,118   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-08-22T23:17:13,120   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-08-22T23:17:13,121   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-08-22T23:17:13,123   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-08-22T23:17:13,124   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-08-22T23:17:13,125   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-08-22T23:17:13,127   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-08-22T23:17:13,128   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-08-22T23:17:13,130   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-08-22T23:17:13,131   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-08-22T23:17:13,133   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-08-22T23:17:13,135   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-08-22T23:17:13,136   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-08-22T23:17:13,137   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-08-22T23:17:13,138   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-08-22T23:17:13,140   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-08-22T23:17:13,141   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-08-22T23:17:13,142   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-08-22T23:17:13,143   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-08-22T23:17:13,145   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-08-22T23:17:13,146   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-08-22T23:17:13,148   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-08-22T23:17:13,150   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-08-22T23:17:13,151   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-08-22T23:17:13,153   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-08-22T23:17:13,155   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-08-22T23:17:13,157   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-08-22T23:17:13,158   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-08-22T23:17:13,160   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-08-22T23:17:13,161   adding 'deepspeed/launcher/__init__.py'
2024-08-22T23:17:13,162   adding 'deepspeed/launcher/constants.py'
2024-08-22T23:17:13,164   adding 'deepspeed/launcher/launch.py'
2024-08-22T23:17:13,166   adding 'deepspeed/launcher/launcher_helper.py'
2024-08-22T23:17:13,168   adding 'deepspeed/launcher/multinode_runner.py'
2024-08-22T23:17:13,171   adding 'deepspeed/launcher/runner.py'
2024-08-22T23:17:13,173   adding 'deepspeed/linear/__init__.py'
2024-08-22T23:17:13,174   adding 'deepspeed/linear/config.py'
2024-08-22T23:17:13,176   adding 'deepspeed/linear/context_manager.py'
2024-08-22T23:17:13,177   adding 'deepspeed/linear/optimized_linear.py'
2024-08-22T23:17:13,179   adding 'deepspeed/linear/quantization.py'
2024-08-22T23:17:13,181   adding 'deepspeed/model_implementations/__init__.py'
2024-08-22T23:17:13,182   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-08-22T23:17:13,183   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-08-22T23:17:13,185   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-08-22T23:17:13,186   adding 'deepspeed/model_implementations/features/__init__.py'
2024-08-22T23:17:13,188   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-08-22T23:17:13,189   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-08-22T23:17:13,191   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-08-22T23:17:13,192   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-08-22T23:17:13,193   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-08-22T23:17:13,194   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-08-22T23:17:13,195   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-08-22T23:17:13,196   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-08-22T23:17:13,197   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-08-22T23:17:13,198   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-08-22T23:17:13,200   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-08-22T23:17:13,202   adding 'deepspeed/module_inject/__init__.py'
2024-08-22T23:17:13,205   adding 'deepspeed/module_inject/auto_tp.py'
2024-08-22T23:17:13,206   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-08-22T23:17:13,208   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-08-22T23:17:13,210   adding 'deepspeed/module_inject/inject.py'
2024-08-22T23:17:13,211   adding 'deepspeed/module_inject/layers.py'
2024-08-22T23:17:13,213   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-08-22T23:17:13,214   adding 'deepspeed/module_inject/module_quantize.py'
2024-08-22T23:17:13,216   adding 'deepspeed/module_inject/policy.py'
2024-08-22T23:17:13,220   adding 'deepspeed/module_inject/replace_module.py'
2024-08-22T23:17:13,221   adding 'deepspeed/module_inject/replace_policy.py'
2024-08-22T23:17:13,222   adding 'deepspeed/module_inject/tp_shard.py'
2024-08-22T23:17:13,223   adding 'deepspeed/module_inject/utils.py'
2024-08-22T23:17:13,225   adding 'deepspeed/module_inject/containers/__init__.py'
2024-08-22T23:17:13,227   adding 'deepspeed/module_inject/containers/base.py'
2024-08-22T23:17:13,229   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-08-22T23:17:13,230   adding 'deepspeed/module_inject/containers/bert.py'
2024-08-22T23:17:13,231   adding 'deepspeed/module_inject/containers/bloom.py'
2024-08-22T23:17:13,233   adding 'deepspeed/module_inject/containers/clip.py'
2024-08-22T23:17:13,234   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-08-22T23:17:13,235   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-08-22T23:17:13,237   adding 'deepspeed/module_inject/containers/gptj.py'
2024-08-22T23:17:13,241   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-08-22T23:17:13,243   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-08-22T23:17:13,244   adding 'deepspeed/module_inject/containers/internlm.py'
2024-08-22T23:17:13,246   adding 'deepspeed/module_inject/containers/llama.py'
2024-08-22T23:17:13,247   adding 'deepspeed/module_inject/containers/llama2.py'
2024-08-22T23:17:13,249   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-08-22T23:17:13,250   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-08-22T23:17:13,252   adding 'deepspeed/module_inject/containers/opt.py'
2024-08-22T23:17:13,253   adding 'deepspeed/module_inject/containers/unet.py'
2024-08-22T23:17:13,254   adding 'deepspeed/module_inject/containers/vae.py'
2024-08-22T23:17:13,256   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-08-22T23:17:13,257   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-08-22T23:17:13,259   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-08-22T23:17:13,260   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-08-22T23:17:13,262   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-08-22T23:17:13,263   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-08-22T23:17:13,265   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-08-22T23:17:13,266   adding 'deepspeed/moe/__init__.py'
2024-08-22T23:17:13,268   adding 'deepspeed/moe/experts.py'
2024-08-22T23:17:13,269   adding 'deepspeed/moe/layer.py'
2024-08-22T23:17:13,270   adding 'deepspeed/moe/mappings.py'
2024-08-22T23:17:13,273   adding 'deepspeed/moe/sharded_moe.py'
2024-08-22T23:17:13,275   adding 'deepspeed/moe/utils.py'
2024-08-22T23:17:13,276   adding 'deepspeed/monitor/__init__.py'
2024-08-22T23:17:13,278   adding 'deepspeed/monitor/comet.py'
2024-08-22T23:17:13,279   adding 'deepspeed/monitor/config.py'
2024-08-22T23:17:13,280   adding 'deepspeed/monitor/csv_monitor.py'
2024-08-22T23:17:13,281   adding 'deepspeed/monitor/monitor.py'
2024-08-22T23:17:13,282   adding 'deepspeed/monitor/tensorboard.py'
2024-08-22T23:17:13,284   adding 'deepspeed/monitor/utils.py'
2024-08-22T23:17:13,285   adding 'deepspeed/monitor/wandb.py'
2024-08-22T23:17:13,287   adding 'deepspeed/nebula/__init__.py'
2024-08-22T23:17:13,288   adding 'deepspeed/nebula/config.py'
2024-08-22T23:17:13,289   adding 'deepspeed/nebula/constants.py'
2024-08-22T23:17:13,291   adding 'deepspeed/ops/__init__.py'
2024-08-22T23:17:13,292   adding 'deepspeed/ops/adagrad/__init__.py'
2024-08-22T23:17:13,294   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-08-22T23:17:13,295   adding 'deepspeed/ops/adam/__init__.py'
2024-08-22T23:17:13,297   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-08-22T23:17:13,298   adding 'deepspeed/ops/adam/fused_adam.py'
2024-08-22T23:17:13,300   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-08-22T23:17:13,301   adding 'deepspeed/ops/aio/__init__.py'
2024-08-22T23:17:13,304   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-08-22T23:17:13,305   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-08-22T23:17:13,307   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-08-22T23:17:13,308   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-08-22T23:17:13,310   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-08-22T23:17:13,311   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-08-22T23:17:13,314   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-08-22T23:17:13,315   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-08-22T23:17:13,316   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-08-22T23:17:13,318   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-08-22T23:17:13,319   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-08-22T23:17:13,320   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-08-22T23:17:13,322   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2024-08-22T23:17:13,324   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2024-08-22T23:17:13,325   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-08-22T23:17:13,326   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-08-22T23:17:13,327   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2024-08-22T23:17:13,328   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2024-08-22T23:17:13,330   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-08-22T23:17:13,331   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-08-22T23:17:13,332   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-08-22T23:17:13,334   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-08-22T23:17:13,335   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-08-22T23:17:13,336   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-08-22T23:17:13,337   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-08-22T23:17:13,338   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-08-22T23:17:13,340   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2024-08-22T23:17:13,341   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2024-08-22T23:17:13,343   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-08-22T23:17:13,344   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-08-22T23:17:13,346   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-08-22T23:17:13,349   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-08-22T23:17:13,352   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-08-22T23:17:13,353   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-08-22T23:17:13,354   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-08-22T23:17:13,356   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-08-22T23:17:13,358   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-08-22T23:17:13,360   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-08-22T23:17:13,361   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-08-22T23:17:13,363   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-08-22T23:17:13,371   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-08-22T23:17:13,375   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-08-22T23:17:13,378   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-08-22T23:17:13,380   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-08-22T23:17:13,382   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-08-22T23:17:13,383   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-08-22T23:17:13,385   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-08-22T23:17:13,387   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-08-22T23:17:13,390   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-08-22T23:17:13,392   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-08-22T23:17:13,394   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-08-22T23:17:13,396   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-08-22T23:17:13,403   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-08-22T23:17:13,406   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-08-22T23:17:13,408   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-08-22T23:17:13,412   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-08-22T23:17:13,415   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-08-22T23:17:13,419   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-08-22T23:17:13,421   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-08-22T23:17:13,423   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-08-22T23:17:13,424   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-08-22T23:17:13,426   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-08-22T23:17:13,428   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-08-22T23:17:13,430   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-08-22T23:17:13,432   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-08-22T23:17:13,433   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-08-22T23:17:13,436   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2024-08-22T23:17:13,437   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2024-08-22T23:17:13,439   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2024-08-22T23:17:13,440   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2024-08-22T23:17:13,441   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2024-08-22T23:17:13,442   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2024-08-22T23:17:13,444   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-08-22T23:17:13,445   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-08-22T23:17:13,446   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-08-22T23:17:13,448   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-08-22T23:17:13,449   adding 'deepspeed/ops/csrc/includes/context.h'
2024-08-22T23:17:13,451   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-08-22T23:17:13,452   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-08-22T23:17:13,453   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-08-22T23:17:13,455   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-08-22T23:17:13,456   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-08-22T23:17:13,458   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-08-22T23:17:13,460   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-08-22T23:17:13,461   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-08-22T23:17:13,462   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-08-22T23:17:13,463   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-08-22T23:17:13,465   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-08-22T23:17:13,466   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-08-22T23:17:13,467   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-08-22T23:17:13,469   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-08-22T23:17:13,471   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-08-22T23:17:13,473   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-08-22T23:17:13,474   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-08-22T23:17:13,476   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-08-22T23:17:13,477   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-08-22T23:17:13,480   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-08-22T23:17:13,481   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-08-22T23:17:13,483   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-08-22T23:17:13,484   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-08-22T23:17:13,486   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-08-22T23:17:13,487   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-08-22T23:17:13,489   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-08-22T23:17:13,491   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-08-22T23:17:13,493   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-08-22T23:17:13,494   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-08-22T23:17:13,495   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-08-22T23:17:13,497   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-08-22T23:17:13,499   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-08-22T23:17:13,502   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-08-22T23:17:13,503   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-08-22T23:17:13,505   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-08-22T23:17:13,506   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-08-22T23:17:13,508   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-08-22T23:17:13,510   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-08-22T23:17:13,512   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-08-22T23:17:13,513   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-08-22T23:17:13,515   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-08-22T23:17:13,516   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-08-22T23:17:13,518   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-08-22T23:17:13,520   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-08-22T23:17:13,521   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-08-22T23:17:13,523   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-08-22T23:17:13,525   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-08-22T23:17:13,528   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-08-22T23:17:13,531   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-08-22T23:17:13,533   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-08-22T23:17:13,535   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-08-22T23:17:13,539   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-08-22T23:17:13,542   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-08-22T23:17:13,544   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-08-22T23:17:13,547   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-08-22T23:17:13,549   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-08-22T23:17:13,552   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-08-22T23:17:13,554   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-08-22T23:17:13,555   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-08-22T23:17:13,561   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-08-22T23:17:13,562   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-08-22T23:17:13,564   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-08-22T23:17:13,566   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-08-22T23:17:13,569   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-08-22T23:17:13,572   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-08-22T23:17:13,573   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-08-22T23:17:13,575   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-08-22T23:17:13,577   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-08-22T23:17:13,579   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-08-22T23:17:13,581   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-08-22T23:17:13,583   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-08-22T23:17:13,584   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-08-22T23:17:13,586   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-08-22T23:17:13,588   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-08-22T23:17:13,590   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-08-22T23:17:13,591   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-08-22T23:17:13,592   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-08-22T23:17:13,594   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-08-22T23:17:13,596   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-08-22T23:17:13,598   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-08-22T23:17:13,599   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-08-22T23:17:13,601   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-08-22T23:17:13,602   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-08-22T23:17:13,604   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-08-22T23:17:13,605   adding 'deepspeed/ops/gds/__init__.py'
2024-08-22T23:17:13,607   adding 'deepspeed/ops/lamb/__init__.py'
2024-08-22T23:17:13,608   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-08-22T23:17:13,610   adding 'deepspeed/ops/lion/__init__.py'
2024-08-22T23:17:13,612   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-08-22T23:17:13,613   adding 'deepspeed/ops/lion/fused_lion.py'
2024-08-22T23:17:13,615   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-08-22T23:17:13,617   adding 'deepspeed/ops/op_builder/__init__.py'
2024-08-22T23:17:13,618   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-08-22T23:17:13,619   adding 'deepspeed/ops/op_builder/async_io.py'
2024-08-22T23:17:13,623   adding 'deepspeed/ops/op_builder/builder.py'
2024-08-22T23:17:13,624   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-08-22T23:17:13,625   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-08-22T23:17:13,626   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-08-22T23:17:13,628   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-08-22T23:17:13,629   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-08-22T23:17:13,630   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-08-22T23:17:13,631   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-08-22T23:17:13,632   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-08-22T23:17:13,634   adding 'deepspeed/ops/op_builder/gds.py'
2024-08-22T23:17:13,635   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-08-22T23:17:13,636   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-08-22T23:17:13,637   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-08-22T23:17:13,639   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-08-22T23:17:13,640   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-08-22T23:17:13,641   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-08-22T23:17:13,642   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-08-22T23:17:13,644   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-08-22T23:17:13,645   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-08-22T23:17:13,646   adding 'deepspeed/ops/op_builder/transformer.py'
2024-08-22T23:17:13,647   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-08-22T23:17:13,649   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-08-22T23:17:13,650   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-08-22T23:17:13,651   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-08-22T23:17:13,652   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-08-22T23:17:13,654   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-08-22T23:17:13,655   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-08-22T23:17:13,657   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-08-22T23:17:13,658   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-08-22T23:17:13,659   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-08-22T23:17:13,661   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-08-22T23:17:13,662   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-08-22T23:17:13,664   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-08-22T23:17:13,665   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-08-22T23:17:13,666   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-08-22T23:17:13,668   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-08-22T23:17:13,669   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-08-22T23:17:13,670   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-08-22T23:17:13,671   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-08-22T23:17:13,673   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-08-22T23:17:13,674   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-08-22T23:17:13,676   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-08-22T23:17:13,678   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-08-22T23:17:13,679   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-08-22T23:17:13,680   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-08-22T23:17:13,681   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-08-22T23:17:13,683   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-08-22T23:17:13,684   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-08-22T23:17:13,685   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-08-22T23:17:13,686   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-08-22T23:17:13,687   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-08-22T23:17:13,689   adding 'deepspeed/ops/quantizer/__init__.py'
2024-08-22T23:17:13,690   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-08-22T23:17:13,692   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-08-22T23:17:13,693   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-08-22T23:17:13,695   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-08-22T23:17:13,696   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-08-22T23:17:13,699   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-08-22T23:17:13,702   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-08-22T23:17:13,703   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-08-22T23:17:13,705   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-08-22T23:17:13,708   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-08-22T23:17:13,710   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-08-22T23:17:13,711   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-08-22T23:17:13,713   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-08-22T23:17:13,714   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-08-22T23:17:13,716   adding 'deepspeed/ops/transformer/__init__.py'
2024-08-22T23:17:13,718   adding 'deepspeed/ops/transformer/transformer.py'
2024-08-22T23:17:13,720   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-08-22T23:17:13,721   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-08-22T23:17:13,722   adding 'deepspeed/ops/transformer/inference/config.py'
2024-08-22T23:17:13,723   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-08-22T23:17:13,725   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-08-22T23:17:13,726   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-08-22T23:17:13,729   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-08-22T23:17:13,730   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-08-22T23:17:13,732   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-08-22T23:17:13,734   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-08-22T23:17:13,736   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-08-22T23:17:13,737   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-08-22T23:17:13,739   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-08-22T23:17:13,740   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-08-22T23:17:13,741   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-08-22T23:17:13,743   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-08-22T23:17:13,744   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-08-22T23:17:13,745   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-08-22T23:17:13,746   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-08-22T23:17:13,748   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-08-22T23:17:13,750   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-08-22T23:17:13,752   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-08-22T23:17:13,753   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-08-22T23:17:13,755   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-08-22T23:17:13,757   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-08-22T23:17:13,758   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-08-22T23:17:13,760   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-08-22T23:17:13,761   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-08-22T23:17:13,762   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-08-22T23:17:13,764   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-08-22T23:17:13,766   adding 'deepspeed/pipe/__init__.py'
2024-08-22T23:17:13,767   adding 'deepspeed/profiling/__init__.py'
2024-08-22T23:17:13,769   adding 'deepspeed/profiling/config.py'
2024-08-22T23:17:13,770   adding 'deepspeed/profiling/constants.py'
2024-08-22T23:17:13,771   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-08-22T23:17:13,776   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-08-22T23:17:13,779   adding 'deepspeed/runtime/__init__.py'
2024-08-22T23:17:13,780   adding 'deepspeed/runtime/base_optimizer.py'
2024-08-22T23:17:13,783   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-08-22T23:17:13,784   adding 'deepspeed/runtime/compiler.py'
2024-08-22T23:17:13,788   adding 'deepspeed/runtime/config.py'
2024-08-22T23:17:13,790   adding 'deepspeed/runtime/config_utils.py'
2024-08-22T23:17:13,792   adding 'deepspeed/runtime/constants.py'
2024-08-22T23:17:13,793   adding 'deepspeed/runtime/dataloader.py'
2024-08-22T23:17:13,795   adding 'deepspeed/runtime/eigenvalue.py'
2024-08-22T23:17:13,813   adding 'deepspeed/runtime/engine.py'
2024-08-22T23:17:13,816   adding 'deepspeed/runtime/hybrid_engine.py'
2024-08-22T23:17:13,820   adding 'deepspeed/runtime/lr_schedules.py'
2024-08-22T23:17:13,826   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-08-22T23:17:13,828   adding 'deepspeed/runtime/quantize.py'
2024-08-22T23:17:13,829   adding 'deepspeed/runtime/sparse_tensor.py'
2024-08-22T23:17:13,831   adding 'deepspeed/runtime/state_dict_factory.py'
2024-08-22T23:17:13,836   adding 'deepspeed/runtime/utils.py'
2024-08-22T23:17:13,838   adding 'deepspeed/runtime/weight_quantizer.py'
2024-08-22T23:17:13,839   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-08-22T23:17:13,844   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-08-22T23:17:13,846   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-08-22T23:17:13,847   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-08-22T23:17:13,848   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-08-22T23:17:13,850   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-08-22T23:17:13,851   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-08-22T23:17:13,853   adding 'deepspeed/runtime/comm/__init__.py'
2024-08-22T23:17:13,854   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-08-22T23:17:13,856   adding 'deepspeed/runtime/comm/compressed.py'
2024-08-22T23:17:13,857   adding 'deepspeed/runtime/comm/hccl.py'
2024-08-22T23:17:13,859   adding 'deepspeed/runtime/comm/mpi.py'
2024-08-22T23:17:13,861   adding 'deepspeed/runtime/comm/nccl.py'
2024-08-22T23:17:13,862   adding 'deepspeed/runtime/compression/__init__.py'
2024-08-22T23:17:13,864   adding 'deepspeed/runtime/compression/cupy.py'
2024-08-22T23:17:13,865   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-08-22T23:17:13,867   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-08-22T23:17:13,868   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-08-22T23:17:13,870   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-08-22T23:17:13,871   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-08-22T23:17:13,873   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-08-22T23:17:13,874   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-08-22T23:17:13,876   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-08-22T23:17:13,877   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-08-22T23:17:13,879   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-08-22T23:17:13,884   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-08-22T23:17:13,886   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-08-22T23:17:13,889   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-08-22T23:17:13,890   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-08-22T23:17:13,892   adding 'deepspeed/runtime/fp16/__init__.py'
2024-08-22T23:17:13,895   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-08-22T23:17:13,897   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-08-22T23:17:13,899   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-08-22T23:17:13,901   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-08-22T23:17:13,903   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-08-22T23:17:13,905   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-08-22T23:17:13,908   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-08-22T23:17:13,909   adding 'deepspeed/runtime/pipe/__init__.py'
2024-08-22T23:17:13,916   adding 'deepspeed/runtime/pipe/engine.py'
2024-08-22T23:17:13,920   adding 'deepspeed/runtime/pipe/module.py'
2024-08-22T23:17:13,921   adding 'deepspeed/runtime/pipe/p2p.py'
2024-08-22T23:17:13,924   adding 'deepspeed/runtime/pipe/schedule.py'
2024-08-22T23:17:13,926   adding 'deepspeed/runtime/pipe/topology.py'
2024-08-22T23:17:13,928   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-08-22T23:17:13,929   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-08-22T23:17:13,930   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-08-22T23:17:13,932   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-08-22T23:17:13,934   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-08-22T23:17:13,935   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-08-22T23:17:13,938   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-08-22T23:17:13,940   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-08-22T23:17:13,941   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-08-22T23:17:13,943   adding 'deepspeed/runtime/zero/__init__.py'
2024-08-22T23:17:13,945   adding 'deepspeed/runtime/zero/config.py'
2024-08-22T23:17:13,947   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-08-22T23:17:13,949   adding 'deepspeed/runtime/zero/linear.py'
2024-08-22T23:17:13,951   adding 'deepspeed/runtime/zero/mics.py'
2024-08-22T23:17:13,953   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-08-22T23:17:13,955   adding 'deepspeed/runtime/zero/offload_config.py'
2024-08-22T23:17:13,957   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-08-22T23:17:13,969   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-08-22T23:17:13,972   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-08-22T23:17:13,974   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-08-22T23:17:13,989   adding 'deepspeed/runtime/zero/stage3.py'
2024-08-22T23:17:14,003   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-08-22T23:17:14,005   adding 'deepspeed/runtime/zero/test.py'
2024-08-22T23:17:14,007   adding 'deepspeed/runtime/zero/tiling.py'
2024-08-22T23:17:14,008   adding 'deepspeed/runtime/zero/utils.py'
2024-08-22T23:17:14,010   adding 'deepspeed/sequence/__init__.py'
2024-08-22T23:17:14,012   adding 'deepspeed/sequence/cross_entropy.py'
2024-08-22T23:17:14,013   adding 'deepspeed/sequence/layer.py'
2024-08-22T23:17:14,015   adding 'deepspeed/utils/__init__.py'
2024-08-22T23:17:14,017   adding 'deepspeed/utils/bwc.py'
2024-08-22T23:17:14,018   adding 'deepspeed/utils/comms_logging.py'
2024-08-22T23:17:14,020   adding 'deepspeed/utils/config.py'
2024-08-22T23:17:14,021   adding 'deepspeed/utils/debug.py'
2024-08-22T23:17:14,022   adding 'deepspeed/utils/exceptions.py'
2024-08-22T23:17:14,025   adding 'deepspeed/utils/groups.py'
2024-08-22T23:17:14,026   adding 'deepspeed/utils/init_on_device.py'
2024-08-22T23:17:14,028   adding 'deepspeed/utils/logging.py'
2024-08-22T23:17:14,029   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-08-22T23:17:14,031   adding 'deepspeed/utils/numa.py'
2024-08-22T23:17:14,032   adding 'deepspeed/utils/nvtx.py'
2024-08-22T23:17:14,034   adding 'deepspeed/utils/tensor_fragment.py'
2024-08-22T23:17:14,036   adding 'deepspeed/utils/timer.py'
2024-08-22T23:17:14,037   adding 'deepspeed/utils/torch.py'
2024-08-22T23:17:14,038   adding 'deepspeed/utils/types.py'
2024-08-22T23:17:14,039   adding 'deepspeed/utils/z3_leaf_module.py'
2024-08-22T23:17:14,042   adding 'deepspeed/utils/zero_to_fp32.py'
2024-08-22T23:17:14,044   adding 'deepspeed-0.15.0.data/scripts/deepspeed'
2024-08-22T23:17:14,045   adding 'deepspeed-0.15.0.data/scripts/deepspeed.pt'
2024-08-22T23:17:14,046   adding 'deepspeed-0.15.0.data/scripts/ds'
2024-08-22T23:17:14,047   adding 'deepspeed-0.15.0.data/scripts/ds_bench'
2024-08-22T23:17:14,048   adding 'deepspeed-0.15.0.data/scripts/ds_elastic'
2024-08-22T23:17:14,049   adding 'deepspeed-0.15.0.data/scripts/ds_report'
2024-08-22T23:17:14,050   adding 'deepspeed-0.15.0.data/scripts/ds_ssh'
2024-08-22T23:17:14,051   adding 'deepspeed-0.15.0.data/scripts/dsr'
2024-08-22T23:17:14,054   adding 'deepspeed-0.15.0.dist-info/LICENSE'
2024-08-22T23:17:14,059   adding 'deepspeed-0.15.0.dist-info/METADATA'
2024-08-22T23:17:14,060   adding 'deepspeed-0.15.0.dist-info/WHEEL'
2024-08-22T23:17:14,061   adding 'deepspeed-0.15.0.dist-info/entry_points.txt'
2024-08-22T23:17:14,062   adding 'deepspeed-0.15.0.dist-info/top_level.txt'
2024-08-22T23:17:14,075   adding 'deepspeed-0.15.0.dist-info/RECORD'
2024-08-22T23:17:14,100   removing build/bdist.linux-armv7l/wheel
2024-08-22T23:17:14,307   deepspeed build time = 10.881795167922974 secs
2024-08-22T23:17:14,433   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-08-22T23:17:14,450   Created wheel for deepspeed: filename=deepspeed-0.15.0-py3-none-any.whl size=1483658 sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda
2024-08-22T23:17:14,451   Stored in directory: /tmp/pip-ephem-wheel-cache-nt5ez9er/wheels/8f/5b/de/79a2a54b4af5d58057e0f4569e6b45c6a853bb404b59007373
2024-08-22T23:17:14,493 Successfully built deepspeed
2024-08-22T23:17:14,535 Removed build tracker: '/tmp/pip-build-tracker-9a5rrot2'