2024-09-05T03:34:57,269 Disabling truststore because Python version isn't 3.10+
2024-09-05T03:34:57,738 Created temporary directory: /tmp/pip-build-tracker-c_h6bql7
2024-09-05T03:34:57,739 Initialized build tracking at /tmp/pip-build-tracker-c_h6bql7
2024-09-05T03:34:57,739 Created build tracker: /tmp/pip-build-tracker-c_h6bql7
2024-09-05T03:34:57,739 Entered build tracker: /tmp/pip-build-tracker-c_h6bql7
2024-09-05T03:34:57,740 Created temporary directory: /tmp/pip-wheel-jb00syrz
2024-09-05T03:34:57,745 Created temporary directory: /tmp/pip-ephem-wheel-cache-odb9bfew
2024-09-05T03:34:57,789 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-09-05T03:34:57,792 2 location(s) to search for versions of deepspeed:
2024-09-05T03:34:57,792 * https://pypi.org/simple/deepspeed/
2024-09-05T03:34:57,792 * https://www.piwheels.org/simple/deepspeed/
2024-09-05T03:34:57,792 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-09-05T03:34:57,793 Getting page https://pypi.org/simple/deepspeed/
2024-09-05T03:34:57,794 Found index url https://pypi.org/simple/
2024-09-05T03:34:57,815 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-09-05T03:34:57,833   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-09-05T03:34:57,833   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-09-05T03:34:57,833   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-09-05T03:34:57,834   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-09-05T03:34:57,834   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-09-05T03:34:57,834   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-09-05T03:34:57,834   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-09-05T03:34:57,835   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-09-05T03:34:57,835   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-09-05T03:34:57,835   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-09-05T03:34:57,835   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-09-05T03:34:57,836   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-09-05T03:34:57,836   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-09-05T03:34:57,836   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-09-05T03:34:57,836   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-09-05T03:34:57,837   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-09-05T03:34:57,837   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-09-05T03:34:57,837   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-09-05T03:34:57,838   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-09-05T03:34:57,838   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-09-05T03:34:57,838   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-09-05T03:34:57,838   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-09-05T03:34:57,839   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-09-05T03:34:57,839   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-09-05T03:34:57,839   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-09-05T03:34:57,839   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-09-05T03:34:57,840   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-09-05T03:34:57,840   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-09-05T03:34:57,840   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-09-05T03:34:57,840   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-09-05T03:34:57,841   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-09-05T03:34:57,841   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-09-05T03:34:57,841   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-09-05T03:34:57,842   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-09-05T03:34:57,842   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-09-05T03:34:57,842   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-09-05T03:34:57,842   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-09-05T03:34:57,843   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-09-05T03:34:57,843   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-09-05T03:34:57,843   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-09-05T03:34:57,843   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-09-05T03:34:57,844   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-09-05T03:34:57,844   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-09-05T03:34:57,844   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-09-05T03:34:57,844   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-09-05T03:34:57,845   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-09-05T03:34:57,845   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-09-05T03:34:57,845   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-09-05T03:34:57,845   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-09-05T03:34:57,846   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-09-05T03:34:57,846   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-09-05T03:34:57,846   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-09-05T03:34:57,846   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-09-05T03:34:57,847   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-09-05T03:34:57,847   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-09-05T03:34:57,847   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-09-05T03:34:57,848   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-09-05T03:34:57,848   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-09-05T03:34:57,848   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-09-05T03:34:57,848   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-09-05T03:34:57,849   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-09-05T03:34:57,849   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-09-05T03:34:57,849   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-09-05T03:34:57,849   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-09-05T03:34:57,850   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-09-05T03:34:57,850   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-09-05T03:34:57,850   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-09-05T03:34:57,850   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-09-05T03:34:57,851   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-09-05T03:34:57,851   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-09-05T03:34:57,851   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-09-05T03:34:57,851   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-09-05T03:34:57,852   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-09-05T03:34:57,852   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-09-05T03:34:57,852   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-09-05T03:34:57,853   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-09-05T03:34:57,853   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-09-05T03:34:57,853   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-09-05T03:34:57,853   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-09-05T03:34:57,854   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-09-05T03:34:57,854   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-09-05T03:34:57,854   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-09-05T03:34:57,854   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-09-05T03:34:57,855   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-09-05T03:34:57,855   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-09-05T03:34:57,855   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-09-05T03:34:57,855   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-09-05T03:34:57,856   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-09-05T03:34:57,856   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-09-05T03:34:57,856   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-09-05T03:34:57,856   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-09-05T03:34:57,857   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-09-05T03:34:57,857   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-09-05T03:34:57,857   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-09-05T03:34:57,857   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-09-05T03:34:57,858   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-09-05T03:34:57,858   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-09-05T03:34:57,858   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-09-05T03:34:57,858   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-09-05T03:34:57,859   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2024-09-05T03:34:57,859   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2024-09-05T03:34:57,859 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-09-05T03:34:57,860 Getting page https://www.piwheels.org/simple/deepspeed/
2024-09-05T03:34:57,861 Found index url https://www.piwheels.org/simple/
2024-09-05T03:34:57,909 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-09-05T03:34:57,927   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,927   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,927   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,927   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,928   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,928   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,928   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,928   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,928   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,929   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,929   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,929   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,929   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,929   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,930   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,930   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,930   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,930   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,930   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,931   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,931   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,931   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,931   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,931   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,932   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,932   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,932   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,932   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,932   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,933   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,933   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,933   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,933   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,933   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,933   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,934   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,934   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,934   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,934   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,934   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,935   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,935   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,935   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,935   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,935   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,936   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,936   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,936   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,936   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,936   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,937   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,937   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,937   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,937   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,937   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,937   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,938   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,938   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,938   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,938   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,938   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,939   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,939   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,939   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,939   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,939   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,940   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,940   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-09-05T03:34:57,940 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-09-05T03:34:57,940 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-09-05T03:34:57,968 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-09-05T03:34:57,970 Collecting deepspeed==0.15.1
2024-09-05T03:34:57,972   Created temporary directory: /tmp/pip-unpack-oq6aek0i
2024-09-05T03:34:57,995   Downloading deepspeed-0.15.1.tar.gz (1.4 MB)
2024-09-05T03:35:00,422   Added deepspeed==0.15.1 from https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz to build tracker '/tmp/pip-build-tracker-c_h6bql7'
2024-09-05T03:35:00,425   Running setup.py (path:/tmp/pip-wheel-jb00syrz/deepspeed_5f5a0840dafe47d5a118268860bbbd64/setup.py) egg_info for package deepspeed
2024-09-05T03:35:00,425   Created temporary directory: /tmp/pip-pip-egg-info-zb3yb8kg
2024-09-05T03:35:00,425   Preparing metadata (setup.py): started
2024-09-05T03:35:00,426   Running command python setup.py egg_info
2024-09-05T03:35:01,430   fatal: not a git repository (or any of the parent directories): .git
2024-09-05T03:35:02,345   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-09-05T03:35:02,345    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-09-05T03:35:02,345   DS_BUILD_OPS=0
2024-09-05T03:35:02,345    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:02,345    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:02,345    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:02,346    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:02,346    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:02,346    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:02,346   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-09-05T03:35:02,346   version=0.15.1, git_hash=unknown, git_branch=unknown
2024-09-05T03:35:02,346   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-09-05T03:35:02,346   ext_modules=[]
2024-09-05T03:35:02,347   running egg_info
2024-09-05T03:35:02,347   creating /tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info
2024-09-05T03:35:02,373   writing /tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info/PKG-INFO
2024-09-05T03:35:02,419   writing dependency_links to /tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info/dependency_links.txt
2024-09-05T03:35:02,421   writing entry points to /tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info/entry_points.txt
2024-09-05T03:35:02,445   writing requirements to /tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info/requires.txt
2024-09-05T03:35:02,446   writing top-level names to /tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info/top_level.txt
2024-09-05T03:35:02,448   writing manifest file '/tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info/SOURCES.txt'
2024-09-05T03:35:02,696   reading manifest file '/tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info/SOURCES.txt'
2024-09-05T03:35:02,698   reading manifest template 'MANIFEST.in'
2024-09-05T03:35:02,700   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-09-05T03:35:02,701   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-09-05T03:35:04,225   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-09-05T03:35:05,153   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-09-05T03:35:05,802   warning: no files found matching '*.tr' under directory 'csrc'
2024-09-05T03:35:05,926   warning: no files found matching '*.cc' under directory 'csrc'
2024-09-05T03:35:05,966   warning: no files found matching '*.py' under directory 'benchmarks'
2024-09-05T03:35:05,972   adding license file 'LICENSE'
2024-09-05T03:35:06,013   writing manifest file '/tmp/pip-pip-egg-info-zb3yb8kg/deepspeed.egg-info/SOURCES.txt'
2024-09-05T03:35:06,015   deepspeed build time = 4.580317735671997 secs
2024-09-05T03:35:06,114   Preparing metadata (setup.py): finished with status 'done'
2024-09-05T03:35:06,121   Source in /tmp/pip-wheel-jb00syrz/deepspeed_5f5a0840dafe47d5a118268860bbbd64 has version 0.15.1, which satisfies requirement deepspeed==0.15.1 from https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz
2024-09-05T03:35:06,122   Removed deepspeed==0.15.1 from https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz from build tracker '/tmp/pip-build-tracker-c_h6bql7'
2024-09-05T03:35:06,157 Created temporary directory: /tmp/pip-unpack-66t33bg1
2024-09-05T03:35:06,158 Created temporary directory: /tmp/pip-unpack-tz8_hdoe
2024-09-05T03:35:06,158 Building wheels for collected packages: deepspeed
2024-09-05T03:35:06,162   Created temporary directory: /tmp/pip-wheel-6gfqk__c
2024-09-05T03:35:06,163   Building wheel for deepspeed (setup.py): started
2024-09-05T03:35:06,163   Destination directory: /tmp/pip-wheel-6gfqk__c
2024-09-05T03:35:06,164   Running command python setup.py bdist_wheel
2024-09-05T03:35:06,674   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-09-05T03:35:06,683    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-09-05T03:35:06,766   DS_BUILD_OPS=0
2024-09-05T03:35:06,890    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:06,891    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:06,891    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:06,892    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:06,892    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:06,894    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-09-05T03:35:06,894   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'gds': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-09-05T03:35:06,915   fatal: not a git repository (or any of the parent directories): .git
2024-09-05T03:35:06,917   version=0.15.1, git_hash=unknown, git_branch=unknown
2024-09-05T03:35:06,918   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2024-09-05T03:35:06,919   ext_modules=[]
2024-09-05T03:35:07,532   running bdist_wheel
2024-09-05T03:35:07,667   running build
2024-09-05T03:35:07,667   running build_py
2024-09-05T03:35:07,697   creating build
2024-09-05T03:35:07,698   creating build/lib
2024-09-05T03:35:07,698   creating build/lib/deepspeed
2024-09-05T03:35:07,699   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-09-05T03:35:07,702   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-09-05T03:35:07,704   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-09-05T03:35:07,706   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-09-05T03:35:07,708   copying deepspeed/constants.py -> build/lib/deepspeed
2024-09-05T03:35:07,710   creating build/lib/deepspeed/launcher
2024-09-05T03:35:07,711   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-09-05T03:35:07,713   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-09-05T03:35:07,716   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-09-05T03:35:07,717   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-09-05T03:35:07,720   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-09-05T03:35:07,722   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-09-05T03:35:07,725   creating build/lib/deepspeed/accelerator
2024-09-05T03:35:07,726   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,728   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,730   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,732   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,734   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,736   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,738   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,740   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,743   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-09-05T03:35:07,746   creating build/lib/deepspeed/comm
2024-09-05T03:35:07,746   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,748   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,750   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,752   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,754   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,756   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,759   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,761   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,762   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-09-05T03:35:07,765   creating build/lib/deepspeed/compression
2024-09-05T03:35:07,766   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-09-05T03:35:07,768   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-09-05T03:35:07,771   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-09-05T03:35:07,781   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-09-05T03:35:07,783   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-09-05T03:35:07,785   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-09-05T03:35:07,788   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-09-05T03:35:07,791   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-09-05T03:35:07,794   creating build/lib/deepspeed/monitor
2024-09-05T03:35:07,795   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-09-05T03:35:07,797   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-09-05T03:35:07,799   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-09-05T03:35:07,800   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-09-05T03:35:07,802   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-09-05T03:35:07,803   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-09-05T03:35:07,805   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-09-05T03:35:07,807   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-09-05T03:35:07,810   creating build/lib/deepspeed/pipe
2024-09-05T03:35:07,811   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-09-05T03:35:07,813   creating build/lib/deepspeed/utils
2024-09-05T03:35:07,814   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,816   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,818   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,820   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,822   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,825   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,827   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,829   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,830   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,832   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,834   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,836   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,839   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,841   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,843   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,845   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,847   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,849   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-09-05T03:35:07,851   creating build/lib/deepspeed/profiling
2024-09-05T03:35:07,852   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-09-05T03:35:07,853   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-09-05T03:35:07,855   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-09-05T03:35:07,857   creating build/lib/deepspeed/runtime
2024-09-05T03:35:07,858   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,861   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,866   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,868   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,870   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,872   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,875   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,877   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,879   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,882   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,883   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,885   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,887   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,889   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,891   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,893   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,895   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,898   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-09-05T03:35:07,901   creating build/lib/deepspeed/module_inject
2024-09-05T03:35:07,902   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,904   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,906   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,907   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,909   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,911   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,914   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,915   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,917   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,920   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,922   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,924   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,926   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-09-05T03:35:07,929   creating build/lib/deepspeed/nebula
2024-09-05T03:35:07,930   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-09-05T03:35:07,931   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-09-05T03:35:07,933   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-09-05T03:35:07,935   creating build/lib/deepspeed/model_implementations
2024-09-05T03:35:07,936   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-09-05T03:35:07,938   creating build/lib/deepspeed/inference
2024-09-05T03:35:07,939   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-09-05T03:35:07,942   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-09-05T03:35:07,943   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-09-05T03:35:07,946   creating build/lib/deepspeed/elasticity
2024-09-05T03:35:07,947   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-09-05T03:35:07,950   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-09-05T03:35:07,952   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-09-05T03:35:07,953   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-09-05T03:35:07,955   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-09-05T03:35:07,957   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-09-05T03:35:07,960   creating build/lib/deepspeed/autotuning
2024-09-05T03:35:07,960   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-09-05T03:35:07,963   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-09-05T03:35:07,964   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-09-05T03:35:07,967   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-09-05T03:35:07,970   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-09-05T03:35:07,972   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-09-05T03:35:07,974   creating build/lib/deepspeed/ops
2024-09-05T03:35:07,975   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-09-05T03:35:07,978   creating build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,979   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,981   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,983   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,985   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,987   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,988   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,990   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,992   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,994   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,996   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-09-05T03:35:07,999   creating build/lib/deepspeed/moe
2024-09-05T03:35:07,999   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-09-05T03:35:08,001   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-09-05T03:35:08,003   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-09-05T03:35:08,006   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-09-05T03:35:08,008   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-09-05T03:35:08,010   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-09-05T03:35:08,012   creating build/lib/deepspeed/sequence
2024-09-05T03:35:08,013   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-09-05T03:35:08,015   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2024-09-05T03:35:08,016   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-09-05T03:35:08,019   creating build/lib/deepspeed/linear
2024-09-05T03:35:08,020   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-09-05T03:35:08,022   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-09-05T03:35:08,024   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-09-05T03:35:08,026   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-09-05T03:35:08,028   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-09-05T03:35:08,030   creating build/lib/deepspeed/profiling/flops_profiler
2024-09-05T03:35:08,031   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-09-05T03:35:08,033   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-09-05T03:35:08,037   creating build/lib/deepspeed/runtime/comm
2024-09-05T03:35:08,038   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-09-05T03:35:08,039   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-09-05T03:35:08,041   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-09-05T03:35:08,043   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-09-05T03:35:08,046   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-09-05T03:35:08,048   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-09-05T03:35:08,051   creating build/lib/deepspeed/runtime/data_pipeline
2024-09-05T03:35:08,051   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-09-05T03:35:08,054   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-09-05T03:35:08,055   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-09-05T03:35:08,057   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-09-05T03:35:08,060   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-09-05T03:35:08,061   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-09-05T03:35:08,064   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-09-05T03:35:08,066   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-09-05T03:35:08,068   creating build/lib/deepspeed/runtime/compression
2024-09-05T03:35:08,069   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-09-05T03:35:08,071   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-09-05T03:35:08,073   creating build/lib/deepspeed/runtime/pipe
2024-09-05T03:35:08,074   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-09-05T03:35:08,077   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-09-05T03:35:08,080   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-09-05T03:35:08,082   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-09-05T03:35:08,084   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-09-05T03:35:08,086   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-09-05T03:35:08,089   creating build/lib/deepspeed/runtime/fp16
2024-09-05T03:35:08,090   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-09-05T03:35:08,091   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-09-05T03:35:08,094   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-09-05T03:35:08,096   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-09-05T03:35:08,099   creating build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,100   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,102   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,105   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,109   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,111   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,113   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,115   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,120   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,122   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,124   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,127   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,129   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,131   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,133   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,135   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,139   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-09-05T03:35:08,142   creating build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,143   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,145   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,147   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,149   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,151   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,153   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,155   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,158   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,160   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-09-05T03:35:08,162   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:08,163   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:08,164   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:08,166   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:08,167   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:08,170   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:08,171   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:08,174   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:08,175   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:08,177   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:08,179   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:08,182   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:08,183   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:08,185   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:08,187   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:08,189   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:08,192   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:08,195   creating build/lib/deepspeed/runtime/fp16/onebit
2024-09-05T03:35:08,196   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-09-05T03:35:08,198   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-09-05T03:35:08,201   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-09-05T03:35:08,203   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-09-05T03:35:08,207   creating build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,208   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,210   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,212   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,214   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,216   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,218   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,220   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,222   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,224   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,226   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,228   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,230   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,232   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,234   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,236   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,238   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,240   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,242   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,244   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-09-05T03:35:08,247   creating build/lib/deepspeed/module_inject/containers/features
2024-09-05T03:35:08,248   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-09-05T03:35:08,250   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-09-05T03:35:08,252   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-09-05T03:35:08,254   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-09-05T03:35:08,255   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-09-05T03:35:08,257   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-09-05T03:35:08,259   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-09-05T03:35:08,263   creating build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,263   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,265   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,267   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,269   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,271   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,272   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,274   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,276   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,278   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,280   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-09-05T03:35:08,282   creating build/lib/deepspeed/model_implementations/diffusers
2024-09-05T03:35:08,283   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-09-05T03:35:08,285   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-09-05T03:35:08,287   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-09-05T03:35:08,290   creating build/lib/deepspeed/model_implementations/features
2024-09-05T03:35:08,290   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-09-05T03:35:08,292   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-09-05T03:35:08,295   creating build/lib/deepspeed/inference/quantization
2024-09-05T03:35:08,295   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-09-05T03:35:08,297   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-09-05T03:35:08,299   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-09-05T03:35:08,301   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-09-05T03:35:08,303   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-09-05T03:35:08,306   creating build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,307   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,310   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,311   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,313   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,315   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,316   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,318   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,320   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,322   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-09-05T03:35:08,324   creating build/lib/deepspeed/inference/v2/ragged
2024-09-05T03:35:08,325   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-09-05T03:35:08,327   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-09-05T03:35:08,329   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-09-05T03:35:08,332   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-09-05T03:35:08,334   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-09-05T03:35:08,336   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-09-05T03:35:08,338   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-09-05T03:35:08,341   creating build/lib/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:08,342   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:08,343   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:08,346   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:08,348   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:08,350   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:08,353   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:08,355   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:08,358   creating build/lib/deepspeed/inference/v2/checkpoint
2024-09-05T03:35:08,359   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-09-05T03:35:08,361   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-09-05T03:35:08,363   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-09-05T03:35:08,365   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-09-05T03:35:08,367   creating build/lib/deepspeed/inference/v2/modules
2024-09-05T03:35:08,368   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-09-05T03:35:08,370   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-09-05T03:35:08,372   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-09-05T03:35:08,375   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-09-05T03:35:08,377   creating build/lib/deepspeed/inference/v2/kernels
2024-09-05T03:35:08,378   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-09-05T03:35:08,379   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-09-05T03:35:08,382   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:08,383   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:08,384   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:08,386   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:08,388   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:08,391   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:08,391   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:08,394   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:08,396   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:08,397   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:08,400   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:08,401   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:08,403   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:08,405   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:08,407   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:08,409   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:08,410   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:08,412   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:08,414   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:08,415   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:08,418   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,419   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,421   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,423   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,425   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,426   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,428   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,430   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,432   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,433   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:08,436   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:08,437   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:08,438   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:08,440   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:08,442   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:08,445   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:08,446   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:08,447   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:08,449   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:08,451   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:08,454   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:08,455   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:08,457   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:08,459   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:08,460   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:08,463   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:08,464   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:08,466   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:08,468   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:08,469   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:08,472   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:08,473   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:08,475   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:08,476   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:08,478   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:08,481   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,482   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,484   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,486   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,488   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,490   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,492   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,494   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,496   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,498   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:08,500   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:08,501   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:08,503   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:08,505   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:08,507   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:08,510   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,511   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,513   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,515   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,516   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,518   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,520   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,522   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,523   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:08,526   creating build/lib/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:08,527   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:08,529   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:08,531   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:08,533   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:08,535   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:08,537   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:08,539   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:08,541   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-09-05T03:35:08,542   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-09-05T03:35:08,545   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-09-05T03:35:08,546   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-09-05T03:35:08,548   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-09-05T03:35:08,550   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-09-05T03:35:08,552   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-09-05T03:35:08,553   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-09-05T03:35:08,555   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-09-05T03:35:08,557   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-09-05T03:35:08,558   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-09-05T03:35:08,560   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-09-05T03:35:08,563   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-09-05T03:35:08,563   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-09-05T03:35:08,565   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-09-05T03:35:08,568   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-09-05T03:35:08,569   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-09-05T03:35:08,571   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-09-05T03:35:08,574   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-09-05T03:35:08,575   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-09-05T03:35:08,577   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-09-05T03:35:08,580   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-09-05T03:35:08,581   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-09-05T03:35:08,584   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-09-05T03:35:08,585   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-09-05T03:35:08,588   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-09-05T03:35:08,589   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-09-05T03:35:08,591   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-09-05T03:35:08,592   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-09-05T03:35:08,594   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-09-05T03:35:08,595   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-09-05T03:35:08,598   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:08,599   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:08,601   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:08,603   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:08,604   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:08,607   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:08,608   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:08,610   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:08,612   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:08,613   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:08,615   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:08,617   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:08,618   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:08,620   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:08,622   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:08,623   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:08,625   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:08,627   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:08,628   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:08,630   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:08,632   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:08,633   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:08,635   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:08,637   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:08,638   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:08,640   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:08,643   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:08,643   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:08,645   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:08,648   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:08,648   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:08,650   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:08,652   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:08,654   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:08,655   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:08,657   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:08,659   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:08,660   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:08,662   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:08,665   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:08,665   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:08,667   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:08,669   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:08,671   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:08,673   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:08,674   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:08,676   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:08,678   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:08,679   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:08,681   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:08,683   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:08,685   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:08,686   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:08,689   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:08,689   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:08,691   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:08,694   creating build/lib/deepspeed/autotuning/tuner
2024-09-05T03:35:08,695   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-09-05T03:35:08,697   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-09-05T03:35:08,699   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-09-05T03:35:08,701   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-09-05T03:35:08,703   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-09-05T03:35:08,704   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-09-05T03:35:08,707   creating build/lib/deepspeed/ops/quantizer
2024-09-05T03:35:08,708   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-09-05T03:35:08,709   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-09-05T03:35:08,711   creating build/lib/deepspeed/ops/adagrad
2024-09-05T03:35:08,712   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-09-05T03:35:08,714   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-09-05T03:35:08,717   creating build/lib/deepspeed/ops/transformer
2024-09-05T03:35:08,718   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-09-05T03:35:08,719   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-09-05T03:35:08,722   creating build/lib/deepspeed/ops/fp_quantizer
2024-09-05T03:35:08,723   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-09-05T03:35:08,726   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-09-05T03:35:08,727   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-09-05T03:35:08,730   creating build/lib/deepspeed/ops/sparse_attention
2024-09-05T03:35:08,731   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-09-05T03:35:08,733   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-09-05T03:35:08,735   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-09-05T03:35:08,737   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-09-05T03:35:08,739   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-09-05T03:35:08,742   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-09-05T03:35:08,745   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-09-05T03:35:08,748   creating build/lib/deepspeed/ops/lamb
2024-09-05T03:35:08,749   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-09-05T03:35:08,751   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-09-05T03:35:08,753   creating build/lib/deepspeed/ops/deepspeed4science
2024-09-05T03:35:08,754   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-09-05T03:35:08,756   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-09-05T03:35:08,759   creating build/lib/deepspeed/ops/gds
2024-09-05T03:35:08,759   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2024-09-05T03:35:08,762   creating build/lib/deepspeed/ops/adam
2024-09-05T03:35:08,763   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-09-05T03:35:08,770   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-09-05T03:35:08,772   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-09-05T03:35:08,775   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-09-05T03:35:08,777   creating build/lib/deepspeed/ops/random_ltd
2024-09-05T03:35:08,778   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-09-05T03:35:08,779   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-09-05T03:35:08,783   creating build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,784   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,786   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,788   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,789   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,791   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,793   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,795   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,797   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,799   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,801   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,803   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,804   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,806   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,808   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,810   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,812   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,814   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,816   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,818   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,819   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,821   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,823   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,825   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,827   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-09-05T03:35:08,830   creating build/lib/deepspeed/ops/lion
2024-09-05T03:35:08,831   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-09-05T03:35:08,833   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-09-05T03:35:08,834   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-09-05T03:35:08,836   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-09-05T03:35:08,839   creating build/lib/deepspeed/ops/aio
2024-09-05T03:35:08,840   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-09-05T03:35:08,843   creating build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,844   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,846   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,847   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,850   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,851   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,853   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,855   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,858   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,860   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,863   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-09-05T03:35:08,866   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,867   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,869   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,872   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,874   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,875   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,878   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,879   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,882   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,884   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,886   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:08,889   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,890   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,892   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,894   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,895   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,897   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,899   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,901   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,903   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,905   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,906   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:08,909   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:08,910   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:08,912   creating build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,913   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,915   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,917   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,918   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,920   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,922   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,924   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,926   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,928   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-09-05T03:35:08,931   creating build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,931   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,933   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,935   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,937   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,938   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,940   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,942   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,944   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,945   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,947   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:08,950   creating build/lib/deepspeed/ops/op_builder/hpu
2024-09-05T03:35:08,951   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-09-05T03:35:08,953   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-09-05T03:35:08,954   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-09-05T03:35:08,956   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-09-05T03:35:08,958   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-09-05T03:35:08,960   creating build/lib/deepspeed/ops/op_builder/cpu
2024-09-05T03:35:08,961   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-09-05T03:35:08,963   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-09-05T03:35:08,964   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-09-05T03:35:08,966   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-09-05T03:35:08,968   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-09-05T03:35:08,970   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-09-05T03:35:08,972   running egg_info
2024-09-05T03:35:08,999   writing deepspeed.egg-info/PKG-INFO
2024-09-05T03:35:09,046   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-09-05T03:35:09,048   writing entry points to deepspeed.egg-info/entry_points.txt
2024-09-05T03:35:09,072   writing requirements to deepspeed.egg-info/requires.txt
2024-09-05T03:35:09,074   writing top-level names to deepspeed.egg-info/top_level.txt
2024-09-05T03:35:09,212   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-09-05T03:35:09,290   reading manifest template 'MANIFEST.in'
2024-09-05T03:35:09,291   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-09-05T03:35:09,292   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-09-05T03:35:10,823   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-09-05T03:35:11,764   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-09-05T03:35:12,395   warning: no files found matching '*.tr' under directory 'csrc'
2024-09-05T03:35:12,512   warning: no files found matching '*.cc' under directory 'csrc'
2024-09-05T03:35:12,550   warning: no files found matching '*.py' under directory 'benchmarks'
2024-09-05T03:35:12,555   adding license file 'LICENSE'
2024-09-05T03:35:12,610   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-09-05T03:35:12,622   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-09-05T03:35:12,622   !!

2024-09-05T03:35:12,622           ********************************************************************************
2024-09-05T03:35:12,622           ############################
2024-09-05T03:35:12,622           # Package would be ignored #
2024-09-05T03:35:12,623           ############################
2024-09-05T03:35:12,623           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-09-05T03:35:12,623           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,623           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,623           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-09-05T03:35:12,623           to the `packages` configuration field.

2024-09-05T03:35:12,623           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,624           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,624           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,624           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,624           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,624           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-09-05T03:35:12,624           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-09-05T03:35:12,625           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,625           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,625           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,625           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,625           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,626           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,626                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,626                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,626                 directory, all directories are treated like packages.
2024-09-05T03:35:12,626           ********************************************************************************

2024-09-05T03:35:12,626   !!
2024-09-05T03:35:12,626     check.warn(importable)
2024-09-05T03:35:12,629   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-09-05T03:35:12,629   !!

2024-09-05T03:35:12,629           ********************************************************************************
2024-09-05T03:35:12,629           ############################
2024-09-05T03:35:12,630           # Package would be ignored #
2024-09-05T03:35:12,630           ############################
2024-09-05T03:35:12,630           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-09-05T03:35:12,630           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,630           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,630           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-09-05T03:35:12,630           to the `packages` configuration field.

2024-09-05T03:35:12,631           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,631           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,631           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,631           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,631           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,632           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-09-05T03:35:12,632           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-09-05T03:35:12,632           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,632           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,632           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,632           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,632           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,633           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,633                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,633                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,633                 directory, all directories are treated like packages.
2024-09-05T03:35:12,633           ********************************************************************************

2024-09-05T03:35:12,634   !!
2024-09-05T03:35:12,634     check.warn(importable)
2024-09-05T03:35:12,634   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-09-05T03:35:12,634   !!

2024-09-05T03:35:12,634           ********************************************************************************
2024-09-05T03:35:12,634           ############################
2024-09-05T03:35:12,634           # Package would be ignored #
2024-09-05T03:35:12,635           ############################
2024-09-05T03:35:12,635           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-09-05T03:35:12,635           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,635           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,635           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-09-05T03:35:12,635           to the `packages` configuration field.

2024-09-05T03:35:12,635           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,636           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,636           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,636           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,636           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,636           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-09-05T03:35:12,636           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-09-05T03:35:12,637           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,637           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,637           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,637           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,637           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,638           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,638                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,638                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,638                 directory, all directories are treated like packages.
2024-09-05T03:35:12,638           ********************************************************************************

2024-09-05T03:35:12,638   !!
2024-09-05T03:35:12,638     check.warn(importable)
2024-09-05T03:35:12,638   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-09-05T03:35:12,639   !!

2024-09-05T03:35:12,639           ********************************************************************************
2024-09-05T03:35:12,639           ############################
2024-09-05T03:35:12,639           # Package would be ignored #
2024-09-05T03:35:12,639           ############################
2024-09-05T03:35:12,639           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-09-05T03:35:12,639           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,640           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,640           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-09-05T03:35:12,640           to the `packages` configuration field.

2024-09-05T03:35:12,640           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,640           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,640           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,640           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,641           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,641           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-09-05T03:35:12,641           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-09-05T03:35:12,641           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,641           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,641           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,642           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,642           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,642           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,642                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,642                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,642                 directory, all directories are treated like packages.
2024-09-05T03:35:12,643           ********************************************************************************

2024-09-05T03:35:12,643   !!
2024-09-05T03:35:12,643     check.warn(importable)
2024-09-05T03:35:12,643   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-09-05T03:35:12,643   !!

2024-09-05T03:35:12,643           ********************************************************************************
2024-09-05T03:35:12,644           ############################
2024-09-05T03:35:12,644           # Package would be ignored #
2024-09-05T03:35:12,644           ############################
2024-09-05T03:35:12,644           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-09-05T03:35:12,644           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,644           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,644           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-09-05T03:35:12,644           to the `packages` configuration field.

2024-09-05T03:35:12,645           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,645           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,645           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,645           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,645           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,646           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-09-05T03:35:12,646           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-09-05T03:35:12,646           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,646           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,646           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,646           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,646           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,647           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,647                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,647                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,647                 directory, all directories are treated like packages.
2024-09-05T03:35:12,647           ********************************************************************************

2024-09-05T03:35:12,647   !!
2024-09-05T03:35:12,648     check.warn(importable)
2024-09-05T03:35:12,648   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-09-05T03:35:12,648   !!

2024-09-05T03:35:12,648           ********************************************************************************
2024-09-05T03:35:12,648           ############################
2024-09-05T03:35:12,648           # Package would be ignored #
2024-09-05T03:35:12,648           ############################
2024-09-05T03:35:12,648           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-09-05T03:35:12,649           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,649           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,649           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-09-05T03:35:12,649           to the `packages` configuration field.

2024-09-05T03:35:12,649           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,649           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,650           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,650           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,650           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,650           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-09-05T03:35:12,650           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-09-05T03:35:12,650           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,651           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,651           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,651           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,651           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,651           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,652                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,652                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,652                 directory, all directories are treated like packages.
2024-09-05T03:35:12,652           ********************************************************************************

2024-09-05T03:35:12,652   !!
2024-09-05T03:35:12,652     check.warn(importable)
2024-09-05T03:35:12,652   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-09-05T03:35:12,652   !!

2024-09-05T03:35:12,653           ********************************************************************************
2024-09-05T03:35:12,653           ############################
2024-09-05T03:35:12,653           # Package would be ignored #
2024-09-05T03:35:12,653           ############################
2024-09-05T03:35:12,653           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-09-05T03:35:12,653           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,653           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,653           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-09-05T03:35:12,654           to the `packages` configuration field.

2024-09-05T03:35:12,654           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,654           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,654           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,654           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,654           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,655           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-09-05T03:35:12,655           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-09-05T03:35:12,655           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,655           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,655           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,655           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,655           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,656           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,656                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,656                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,656                 directory, all directories are treated like packages.
2024-09-05T03:35:12,656           ********************************************************************************

2024-09-05T03:35:12,656   !!
2024-09-05T03:35:12,656     check.warn(importable)
2024-09-05T03:35:12,657   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-09-05T03:35:12,657   !!

2024-09-05T03:35:12,657           ********************************************************************************
2024-09-05T03:35:12,657           ############################
2024-09-05T03:35:12,657           # Package would be ignored #
2024-09-05T03:35:12,657           ############################
2024-09-05T03:35:12,657           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-09-05T03:35:12,657           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,658           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,658           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-09-05T03:35:12,658           to the `packages` configuration field.

2024-09-05T03:35:12,658           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,658           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,658           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,658           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,659           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,659           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-09-05T03:35:12,659           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-09-05T03:35:12,659           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,659           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,659           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,660           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,660           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,660           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,660                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,660                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,660                 directory, all directories are treated like packages.
2024-09-05T03:35:12,661           ********************************************************************************

2024-09-05T03:35:12,661   !!
2024-09-05T03:35:12,661     check.warn(importable)
2024-09-05T03:35:12,661   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-09-05T03:35:12,661   !!

2024-09-05T03:35:12,661           ********************************************************************************
2024-09-05T03:35:12,662           ############################
2024-09-05T03:35:12,662           # Package would be ignored #
2024-09-05T03:35:12,662           ############################
2024-09-05T03:35:12,662           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-09-05T03:35:12,662           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,662           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,662           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-09-05T03:35:12,662           to the `packages` configuration field.

2024-09-05T03:35:12,663           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,663           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,663           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,663           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,663           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,663           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-09-05T03:35:12,664           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-09-05T03:35:12,664           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,664           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,664           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,664           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,664           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,665           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,665                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,665                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,665                 directory, all directories are treated like packages.
2024-09-05T03:35:12,665           ********************************************************************************

2024-09-05T03:35:12,665   !!
2024-09-05T03:35:12,666     check.warn(importable)
2024-09-05T03:35:12,666   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-09-05T03:35:12,666   !!

2024-09-05T03:35:12,666           ********************************************************************************
2024-09-05T03:35:12,666           ############################
2024-09-05T03:35:12,666           # Package would be ignored #
2024-09-05T03:35:12,666           ############################
2024-09-05T03:35:12,666           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-09-05T03:35:12,666           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,667           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,667           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-09-05T03:35:12,667           to the `packages` configuration field.

2024-09-05T03:35:12,667           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,667           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,667           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,668           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,668           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,668           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-09-05T03:35:12,668           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-09-05T03:35:12,668           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,668           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,668           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,669           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,669           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,669           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,669                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,669                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,669                 directory, all directories are treated like packages.
2024-09-05T03:35:12,670           ********************************************************************************

2024-09-05T03:35:12,670   !!
2024-09-05T03:35:12,670     check.warn(importable)
2024-09-05T03:35:12,670   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-09-05T03:35:12,670   !!

2024-09-05T03:35:12,670           ********************************************************************************
2024-09-05T03:35:12,670           ############################
2024-09-05T03:35:12,670           # Package would be ignored #
2024-09-05T03:35:12,671           ############################
2024-09-05T03:35:12,671           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-09-05T03:35:12,671           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,671           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,671           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-09-05T03:35:12,671           to the `packages` configuration field.

2024-09-05T03:35:12,671           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,672           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,672           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,672           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,672           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,672           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-09-05T03:35:12,672           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-09-05T03:35:12,673           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,673           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,673           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,673           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,673           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,673           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,674                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,674                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,674                 directory, all directories are treated like packages.
2024-09-05T03:35:12,674           ********************************************************************************

2024-09-05T03:35:12,674   !!
2024-09-05T03:35:12,674     check.warn(importable)
2024-09-05T03:35:12,674   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-09-05T03:35:12,674   !!

2024-09-05T03:35:12,675           ********************************************************************************
2024-09-05T03:35:12,675           ############################
2024-09-05T03:35:12,675           # Package would be ignored #
2024-09-05T03:35:12,675           ############################
2024-09-05T03:35:12,675           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-09-05T03:35:12,675           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,675           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,675           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-09-05T03:35:12,676           to the `packages` configuration field.

2024-09-05T03:35:12,676           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,676           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,676           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,676           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,676           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,677           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-09-05T03:35:12,677           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-09-05T03:35:12,677           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,677           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,677           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,677           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,678           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,678           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,678                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,678                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,678                 directory, all directories are treated like packages.
2024-09-05T03:35:12,678           ********************************************************************************

2024-09-05T03:35:12,679   !!
2024-09-05T03:35:12,679     check.warn(importable)
2024-09-05T03:35:12,679   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-09-05T03:35:12,679   !!

2024-09-05T03:35:12,679           ********************************************************************************
2024-09-05T03:35:12,679           ############################
2024-09-05T03:35:12,679           # Package would be ignored #
2024-09-05T03:35:12,679           ############################
2024-09-05T03:35:12,680           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-09-05T03:35:12,680           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,680           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,680           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-09-05T03:35:12,680           to the `packages` configuration field.

2024-09-05T03:35:12,680           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,680           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,681           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,681           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,681           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,681           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-09-05T03:35:12,681           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-09-05T03:35:12,681           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,682           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,682           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,682           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,682           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,682           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,682                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,683                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,683                 directory, all directories are treated like packages.
2024-09-05T03:35:12,683           ********************************************************************************

2024-09-05T03:35:12,683   !!
2024-09-05T03:35:12,683     check.warn(importable)
2024-09-05T03:35:12,683   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-09-05T03:35:12,683   !!

2024-09-05T03:35:12,683           ********************************************************************************
2024-09-05T03:35:12,684           ############################
2024-09-05T03:35:12,684           # Package would be ignored #
2024-09-05T03:35:12,684           ############################
2024-09-05T03:35:12,684           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-09-05T03:35:12,684           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,684           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,684           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-09-05T03:35:12,684           to the `packages` configuration field.

2024-09-05T03:35:12,685           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,685           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,685           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,685           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,685           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,685           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-09-05T03:35:12,686           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-09-05T03:35:12,686           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,686           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,686           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,686           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,686           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,687           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,687                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,687                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,687                 directory, all directories are treated like packages.
2024-09-05T03:35:12,687           ********************************************************************************

2024-09-05T03:35:12,687   !!
2024-09-05T03:35:12,687     check.warn(importable)
2024-09-05T03:35:12,687   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-09-05T03:35:12,688   !!

2024-09-05T03:35:12,688           ********************************************************************************
2024-09-05T03:35:12,688           ############################
2024-09-05T03:35:12,688           # Package would be ignored #
2024-09-05T03:35:12,688           ############################
2024-09-05T03:35:12,688           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-09-05T03:35:12,688           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,688           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,689           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-09-05T03:35:12,689           to the `packages` configuration field.

2024-09-05T03:35:12,689           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,689           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,689           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,689           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,689           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,690           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-09-05T03:35:12,690           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-09-05T03:35:12,690           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,690           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,690           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,690           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,691           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,691           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,691                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,691                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,691                 directory, all directories are treated like packages.
2024-09-05T03:35:12,691           ********************************************************************************

2024-09-05T03:35:12,691   !!
2024-09-05T03:35:12,692     check.warn(importable)
2024-09-05T03:35:12,692   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-09-05T03:35:12,692   !!

2024-09-05T03:35:12,692           ********************************************************************************
2024-09-05T03:35:12,692           ############################
2024-09-05T03:35:12,692           # Package would be ignored #
2024-09-05T03:35:12,692           ############################
2024-09-05T03:35:12,692           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-09-05T03:35:12,693           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,693           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,693           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-09-05T03:35:12,693           to the `packages` configuration field.

2024-09-05T03:35:12,693           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,693           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,693           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,694           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,694           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,694           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-09-05T03:35:12,694           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-09-05T03:35:12,694           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,694           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,695           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,695           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,695           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,695           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,695                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,695                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,696                 directory, all directories are treated like packages.
2024-09-05T03:35:12,696           ********************************************************************************

2024-09-05T03:35:12,696   !!
2024-09-05T03:35:12,696     check.warn(importable)
2024-09-05T03:35:12,696   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-09-05T03:35:12,696   !!

2024-09-05T03:35:12,696           ********************************************************************************
2024-09-05T03:35:12,697           ############################
2024-09-05T03:35:12,697           # Package would be ignored #
2024-09-05T03:35:12,697           ############################
2024-09-05T03:35:12,697           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-09-05T03:35:12,697           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,697           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,697           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-09-05T03:35:12,697           to the `packages` configuration field.

2024-09-05T03:35:12,698           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,698           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,698           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,698           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,698           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,699           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-09-05T03:35:12,699           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-09-05T03:35:12,699           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,699           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,699           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,699           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,699           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,700           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,700                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,700                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,700                 directory, all directories are treated like packages.
2024-09-05T03:35:12,700           ********************************************************************************

2024-09-05T03:35:12,700   !!
2024-09-05T03:35:12,700     check.warn(importable)
2024-09-05T03:35:12,701   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-09-05T03:35:12,701   !!

2024-09-05T03:35:12,701           ********************************************************************************
2024-09-05T03:35:12,701           ############################
2024-09-05T03:35:12,701           # Package would be ignored #
2024-09-05T03:35:12,701           ############################
2024-09-05T03:35:12,701           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-09-05T03:35:12,701           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,702           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,702           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-09-05T03:35:12,702           to the `packages` configuration field.

2024-09-05T03:35:12,702           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,702           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,702           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,702           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,703           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,703           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-09-05T03:35:12,703           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-09-05T03:35:12,703           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,703           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,703           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,703           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,704           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,704           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,704                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,704                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,704                 directory, all directories are treated like packages.
2024-09-05T03:35:12,704           ********************************************************************************

2024-09-05T03:35:12,705   !!
2024-09-05T03:35:12,705     check.warn(importable)
2024-09-05T03:35:12,705   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-09-05T03:35:12,705   !!

2024-09-05T03:35:12,705           ********************************************************************************
2024-09-05T03:35:12,705           ############################
2024-09-05T03:35:12,705           # Package would be ignored #
2024-09-05T03:35:12,705           ############################
2024-09-05T03:35:12,706           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-09-05T03:35:12,706           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,706           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,706           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-09-05T03:35:12,706           to the `packages` configuration field.

2024-09-05T03:35:12,706           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,706           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,706           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,707           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,707           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,707           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-09-05T03:35:12,707           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-09-05T03:35:12,707           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,707           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,708           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,708           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,708           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,708           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,708                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,708                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,709                 directory, all directories are treated like packages.
2024-09-05T03:35:12,709           ********************************************************************************

2024-09-05T03:35:12,709   !!
2024-09-05T03:35:12,709     check.warn(importable)
2024-09-05T03:35:12,709   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-09-05T03:35:12,709   !!

2024-09-05T03:35:12,709           ********************************************************************************
2024-09-05T03:35:12,709           ############################
2024-09-05T03:35:12,710           # Package would be ignored #
2024-09-05T03:35:12,710           ############################
2024-09-05T03:35:12,710           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-09-05T03:35:12,710           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,710           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,710           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-09-05T03:35:12,710           to the `packages` configuration field.

2024-09-05T03:35:12,711           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,711           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,711           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,711           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,711           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,712           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-09-05T03:35:12,712           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-09-05T03:35:12,712           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,712           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,712           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,712           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,712           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,713           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,713                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,713                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,713                 directory, all directories are treated like packages.
2024-09-05T03:35:12,713           ********************************************************************************

2024-09-05T03:35:12,713   !!
2024-09-05T03:35:12,713     check.warn(importable)
2024-09-05T03:35:12,714   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-09-05T03:35:12,714   !!

2024-09-05T03:35:12,714           ********************************************************************************
2024-09-05T03:35:12,714           ############################
2024-09-05T03:35:12,714           # Package would be ignored #
2024-09-05T03:35:12,714           ############################
2024-09-05T03:35:12,714           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-09-05T03:35:12,714           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,715           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,715           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-09-05T03:35:12,715           to the `packages` configuration field.

2024-09-05T03:35:12,715           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,715           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,715           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,716           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,716           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,716           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-09-05T03:35:12,716           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-09-05T03:35:12,716           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,716           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,716           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,717           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,717           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,717           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,717                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,717                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,717                 directory, all directories are treated like packages.
2024-09-05T03:35:12,718           ********************************************************************************

2024-09-05T03:35:12,718   !!
2024-09-05T03:35:12,718     check.warn(importable)
2024-09-05T03:35:12,718   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-09-05T03:35:12,718   !!

2024-09-05T03:35:12,718           ********************************************************************************
2024-09-05T03:35:12,718           ############################
2024-09-05T03:35:12,719           # Package would be ignored #
2024-09-05T03:35:12,719           ############################
2024-09-05T03:35:12,719           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-09-05T03:35:12,719           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,719           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,719           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-09-05T03:35:12,719           to the `packages` configuration field.

2024-09-05T03:35:12,719           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,720           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,720           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,720           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,720           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,720           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-09-05T03:35:12,720           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-09-05T03:35:12,720           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,721           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,721           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,721           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,721           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,721           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,722                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,722                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,722                 directory, all directories are treated like packages.
2024-09-05T03:35:12,722           ********************************************************************************

2024-09-05T03:35:12,722   !!
2024-09-05T03:35:12,722     check.warn(importable)
2024-09-05T03:35:12,722   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-09-05T03:35:12,722   !!

2024-09-05T03:35:12,723           ********************************************************************************
2024-09-05T03:35:12,723           ############################
2024-09-05T03:35:12,723           # Package would be ignored #
2024-09-05T03:35:12,723           ############################
2024-09-05T03:35:12,723           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-09-05T03:35:12,723           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,723           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,723           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-09-05T03:35:12,724           to the `packages` configuration field.

2024-09-05T03:35:12,724           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,724           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,724           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,724           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,724           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,725           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-09-05T03:35:12,725           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-09-05T03:35:12,725           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,725           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,725           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,725           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,725           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,726           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,726                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,726                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,726                 directory, all directories are treated like packages.
2024-09-05T03:35:12,726           ********************************************************************************

2024-09-05T03:35:12,726   !!
2024-09-05T03:35:12,726     check.warn(importable)
2024-09-05T03:35:12,727   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2024-09-05T03:35:12,727   !!

2024-09-05T03:35:12,727           ********************************************************************************
2024-09-05T03:35:12,727           ############################
2024-09-05T03:35:12,727           # Package would be ignored #
2024-09-05T03:35:12,727           ############################
2024-09-05T03:35:12,727           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2024-09-05T03:35:12,728           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,728           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,728           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2024-09-05T03:35:12,728           to the `packages` configuration field.

2024-09-05T03:35:12,728           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,728           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,728           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,729           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,729           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,729           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2024-09-05T03:35:12,729           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2024-09-05T03:35:12,729           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,729           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,729           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,730           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,730           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,730           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,730                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,730                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,731                 directory, all directories are treated like packages.
2024-09-05T03:35:12,731           ********************************************************************************

2024-09-05T03:35:12,731   !!
2024-09-05T03:35:12,731     check.warn(importable)
2024-09-05T03:35:12,731   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-09-05T03:35:12,731   !!

2024-09-05T03:35:12,731           ********************************************************************************
2024-09-05T03:35:12,732           ############################
2024-09-05T03:35:12,732           # Package would be ignored #
2024-09-05T03:35:12,732           ############################
2024-09-05T03:35:12,732           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-09-05T03:35:12,732           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,732           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,732           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-09-05T03:35:12,732           to the `packages` configuration field.

2024-09-05T03:35:12,733           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,733           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,733           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,733           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,733           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,733           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-09-05T03:35:12,734           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-09-05T03:35:12,734           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,734           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,734           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,734           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,734           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,735           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,735                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,735                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,735                 directory, all directories are treated like packages.
2024-09-05T03:35:12,735           ********************************************************************************

2024-09-05T03:35:12,735   !!
2024-09-05T03:35:12,736     check.warn(importable)
2024-09-05T03:35:12,736   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-09-05T03:35:12,736   !!

2024-09-05T03:35:12,736           ********************************************************************************
2024-09-05T03:35:12,736           ############################
2024-09-05T03:35:12,736           # Package would be ignored #
2024-09-05T03:35:12,736           ############################
2024-09-05T03:35:12,737           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-09-05T03:35:12,737           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,737           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,737           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-09-05T03:35:12,737           to the `packages` configuration field.

2024-09-05T03:35:12,737           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,738           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,738           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,738           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,738           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,738           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-09-05T03:35:12,738           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-09-05T03:35:12,739           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,739           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,739           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,739           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,739           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,740           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,740                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,740                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,740                 directory, all directories are treated like packages.
2024-09-05T03:35:12,740           ********************************************************************************

2024-09-05T03:35:12,740   !!
2024-09-05T03:35:12,741     check.warn(importable)
2024-09-05T03:35:12,741   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-09-05T03:35:12,741   !!

2024-09-05T03:35:12,741           ********************************************************************************
2024-09-05T03:35:12,741           ############################
2024-09-05T03:35:12,741           # Package would be ignored #
2024-09-05T03:35:12,741           ############################
2024-09-05T03:35:12,742           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-09-05T03:35:12,742           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,742           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,742           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-09-05T03:35:12,742           to the `packages` configuration field.

2024-09-05T03:35:12,742           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,743           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,743           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,743           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,743           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,743           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-09-05T03:35:12,743           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-09-05T03:35:12,744           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,744           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,744           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,744           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,744           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,745           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,745                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,745                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,745                 directory, all directories are treated like packages.
2024-09-05T03:35:12,745           ********************************************************************************

2024-09-05T03:35:12,745   !!
2024-09-05T03:35:12,745     check.warn(importable)
2024-09-05T03:35:12,745   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-09-05T03:35:12,746   !!

2024-09-05T03:35:12,746           ********************************************************************************
2024-09-05T03:35:12,746           ############################
2024-09-05T03:35:12,746           # Package would be ignored #
2024-09-05T03:35:12,746           ############################
2024-09-05T03:35:12,746           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-09-05T03:35:12,746           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,747           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,747           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-09-05T03:35:12,747           to the `packages` configuration field.

2024-09-05T03:35:12,747           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,747           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,747           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,747           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,748           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,748           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-09-05T03:35:12,748           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-09-05T03:35:12,748           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,748           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,748           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,749           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,749           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,749           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,749                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,749                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,749                 directory, all directories are treated like packages.
2024-09-05T03:35:12,749           ********************************************************************************

2024-09-05T03:35:12,750   !!
2024-09-05T03:35:12,750     check.warn(importable)
2024-09-05T03:35:12,750   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-09-05T03:35:12,750   !!

2024-09-05T03:35:12,750           ********************************************************************************
2024-09-05T03:35:12,750           ############################
2024-09-05T03:35:12,750           # Package would be ignored #
2024-09-05T03:35:12,751           ############################
2024-09-05T03:35:12,751           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-09-05T03:35:12,751           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,751           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,751           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-09-05T03:35:12,751           to the `packages` configuration field.

2024-09-05T03:35:12,751           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,752           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,752           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,752           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,752           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,752           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-09-05T03:35:12,752           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-09-05T03:35:12,752           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,753           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,753           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,753           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,753           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,753           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,754                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,754                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,754                 directory, all directories are treated like packages.
2024-09-05T03:35:12,754           ********************************************************************************

2024-09-05T03:35:12,754   !!
2024-09-05T03:35:12,754     check.warn(importable)
2024-09-05T03:35:12,754   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-09-05T03:35:12,754   !!

2024-09-05T03:35:12,755           ********************************************************************************
2024-09-05T03:35:12,755           ############################
2024-09-05T03:35:12,755           # Package would be ignored #
2024-09-05T03:35:12,755           ############################
2024-09-05T03:35:12,755           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-09-05T03:35:12,755           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,756           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,756           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-09-05T03:35:12,756           to the `packages` configuration field.

2024-09-05T03:35:12,756           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,756           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,756           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,756           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,757           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,757           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-09-05T03:35:12,757           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-09-05T03:35:12,757           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,757           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,757           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,758           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,758           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,758           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,758                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,759                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,759                 directory, all directories are treated like packages.
2024-09-05T03:35:12,759           ********************************************************************************

2024-09-05T03:35:12,759   !!
2024-09-05T03:35:12,759     check.warn(importable)
2024-09-05T03:35:12,759   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-09-05T03:35:12,759   !!

2024-09-05T03:35:12,760           ********************************************************************************
2024-09-05T03:35:12,760           ############################
2024-09-05T03:35:12,760           # Package would be ignored #
2024-09-05T03:35:12,760           ############################
2024-09-05T03:35:12,760           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-09-05T03:35:12,760           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,760           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,761           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-09-05T03:35:12,761           to the `packages` configuration field.

2024-09-05T03:35:12,761           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,761           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,761           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,761           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,762           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,762           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-09-05T03:35:12,762           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-09-05T03:35:12,762           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,762           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,762           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,763           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,763           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,763           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,763                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,764                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,764                 directory, all directories are treated like packages.
2024-09-05T03:35:12,764           ********************************************************************************

2024-09-05T03:35:12,764   !!
2024-09-05T03:35:12,764     check.warn(importable)
2024-09-05T03:35:12,764   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-09-05T03:35:12,764   !!

2024-09-05T03:35:12,765           ********************************************************************************
2024-09-05T03:35:12,765           ############################
2024-09-05T03:35:12,765           # Package would be ignored #
2024-09-05T03:35:12,765           ############################
2024-09-05T03:35:12,765           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-09-05T03:35:12,765           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,766           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,766           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-09-05T03:35:12,766           to the `packages` configuration field.

2024-09-05T03:35:12,766           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,766           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,766           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,767           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,767           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,767           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-09-05T03:35:12,767           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-09-05T03:35:12,767           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,767           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,768           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,768           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,768           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,768           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,769                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,769                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,769                 directory, all directories are treated like packages.
2024-09-05T03:35:12,769           ********************************************************************************

2024-09-05T03:35:12,769   !!
2024-09-05T03:35:12,769     check.warn(importable)
2024-09-05T03:35:12,769   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-09-05T03:35:12,770   !!

2024-09-05T03:35:12,770           ********************************************************************************
2024-09-05T03:35:12,770           ############################
2024-09-05T03:35:12,770           # Package would be ignored #
2024-09-05T03:35:12,770           ############################
2024-09-05T03:35:12,770           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-09-05T03:35:12,770           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,771           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,771           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-09-05T03:35:12,771           to the `packages` configuration field.

2024-09-05T03:35:12,771           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,771           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,771           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,772           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,772           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,772           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-09-05T03:35:12,772           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-09-05T03:35:12,772           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,772           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,773           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,773           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,773           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,773           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,774                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,774                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,774                 directory, all directories are treated like packages.
2024-09-05T03:35:12,774           ********************************************************************************

2024-09-05T03:35:12,774   !!
2024-09-05T03:35:12,774     check.warn(importable)
2024-09-05T03:35:12,774   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-09-05T03:35:12,775   !!

2024-09-05T03:35:12,775           ********************************************************************************
2024-09-05T03:35:12,775           ############################
2024-09-05T03:35:12,775           # Package would be ignored #
2024-09-05T03:35:12,775           ############################
2024-09-05T03:35:12,775           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-09-05T03:35:12,775           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,776           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,776           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-09-05T03:35:12,776           to the `packages` configuration field.

2024-09-05T03:35:12,776           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,776           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,776           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,777           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,777           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,777           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-09-05T03:35:12,777           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-09-05T03:35:12,777           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,777           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,778           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,778           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,778           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,778           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,779                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,779                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,779                 directory, all directories are treated like packages.
2024-09-05T03:35:12,779           ********************************************************************************

2024-09-05T03:35:12,779   !!
2024-09-05T03:35:12,779     check.warn(importable)
2024-09-05T03:35:12,779   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-09-05T03:35:12,780   !!

2024-09-05T03:35:12,780           ********************************************************************************
2024-09-05T03:35:12,780           ############################
2024-09-05T03:35:12,780           # Package would be ignored #
2024-09-05T03:35:12,780           ############################
2024-09-05T03:35:12,780           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-09-05T03:35:12,780           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,781           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,781           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-09-05T03:35:12,781           to the `packages` configuration field.

2024-09-05T03:35:12,781           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,781           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,781           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,782           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,782           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,782           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-09-05T03:35:12,782           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-09-05T03:35:12,782           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,783           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,783           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,783           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,783           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,784           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,784                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,784                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,784                 directory, all directories are treated like packages.
2024-09-05T03:35:12,784           ********************************************************************************

2024-09-05T03:35:12,784   !!
2024-09-05T03:35:12,784     check.warn(importable)
2024-09-05T03:35:12,784   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-09-05T03:35:12,785   !!

2024-09-05T03:35:12,785           ********************************************************************************
2024-09-05T03:35:12,785           ############################
2024-09-05T03:35:12,785           # Package would be ignored #
2024-09-05T03:35:12,785           ############################
2024-09-05T03:35:12,785           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-09-05T03:35:12,785           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,786           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,786           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-09-05T03:35:12,786           to the `packages` configuration field.

2024-09-05T03:35:12,786           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,786           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,786           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,787           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,787           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,787           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-09-05T03:35:12,787           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-09-05T03:35:12,787           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,787           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,788           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,788           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,788           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,788           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,788                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,789                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,789                 directory, all directories are treated like packages.
2024-09-05T03:35:12,789           ********************************************************************************

2024-09-05T03:35:12,789   !!
2024-09-05T03:35:12,789     check.warn(importable)
2024-09-05T03:35:12,789   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-09-05T03:35:12,789   !!

2024-09-05T03:35:12,790           ********************************************************************************
2024-09-05T03:35:12,790           ############################
2024-09-05T03:35:12,790           # Package would be ignored #
2024-09-05T03:35:12,790           ############################
2024-09-05T03:35:12,790           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-09-05T03:35:12,790           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,790           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,791           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-09-05T03:35:12,791           to the `packages` configuration field.

2024-09-05T03:35:12,791           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,791           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,791           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,791           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,792           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,792           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-09-05T03:35:12,792           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-09-05T03:35:12,792           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,792           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,792           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,793           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,793           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,793           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,793                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,793                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,793                 directory, all directories are treated like packages.
2024-09-05T03:35:12,794           ********************************************************************************

2024-09-05T03:35:12,794   !!
2024-09-05T03:35:12,794     check.warn(importable)
2024-09-05T03:35:12,794   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-09-05T03:35:12,794   !!

2024-09-05T03:35:12,794           ********************************************************************************
2024-09-05T03:35:12,795           ############################
2024-09-05T03:35:12,795           # Package would be ignored #
2024-09-05T03:35:12,795           ############################
2024-09-05T03:35:12,795           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-09-05T03:35:12,795           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,795           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,795           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-09-05T03:35:12,795           to the `packages` configuration field.

2024-09-05T03:35:12,796           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,796           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,796           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,796           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,796           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,797           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-09-05T03:35:12,797           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-09-05T03:35:12,797           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,797           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,797           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,797           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,797           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,798           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,798                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,798                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,798                 directory, all directories are treated like packages.
2024-09-05T03:35:12,798           ********************************************************************************

2024-09-05T03:35:12,799   !!
2024-09-05T03:35:12,799     check.warn(importable)
2024-09-05T03:35:12,799   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-09-05T03:35:12,799   !!

2024-09-05T03:35:12,799           ********************************************************************************
2024-09-05T03:35:12,799           ############################
2024-09-05T03:35:12,799           # Package would be ignored #
2024-09-05T03:35:12,800           ############################
2024-09-05T03:35:12,800           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-09-05T03:35:12,800           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,800           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,800           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-09-05T03:35:12,800           to the `packages` configuration field.

2024-09-05T03:35:12,800           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,801           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,801           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,801           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,801           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,802           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-09-05T03:35:12,802           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-09-05T03:35:12,802           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,802           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,802           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,802           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,803           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,803           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,803                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,803                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,803                 directory, all directories are treated like packages.
2024-09-05T03:35:12,803           ********************************************************************************

2024-09-05T03:35:12,804   !!
2024-09-05T03:35:12,804     check.warn(importable)
2024-09-05T03:35:12,804   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-09-05T03:35:12,804   !!

2024-09-05T03:35:12,804           ********************************************************************************
2024-09-05T03:35:12,804           ############################
2024-09-05T03:35:12,805           # Package would be ignored #
2024-09-05T03:35:12,805           ############################
2024-09-05T03:35:12,805           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-09-05T03:35:12,805           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,805           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,805           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-09-05T03:35:12,805           to the `packages` configuration field.

2024-09-05T03:35:12,806           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,806           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,806           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,806           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,806           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,807           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-09-05T03:35:12,807           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-09-05T03:35:12,807           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,807           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,807           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,807           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,807           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,808           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,808                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,808                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,808                 directory, all directories are treated like packages.
2024-09-05T03:35:12,808           ********************************************************************************

2024-09-05T03:35:12,809   !!
2024-09-05T03:35:12,809     check.warn(importable)
2024-09-05T03:35:12,809   /usr/local/lib/python3.9/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-09-05T03:35:12,809   !!

2024-09-05T03:35:12,809           ********************************************************************************
2024-09-05T03:35:12,809           ############################
2024-09-05T03:35:12,809           # Package would be ignored #
2024-09-05T03:35:12,809           ############################
2024-09-05T03:35:12,810           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-09-05T03:35:12,810           but it is absent from setuptools' `packages` configuration.

2024-09-05T03:35:12,810           This leads to an ambiguous overall configuration. If you want to distribute this
2024-09-05T03:35:12,810           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-09-05T03:35:12,810           to the `packages` configuration field.

2024-09-05T03:35:12,810           Alternatively, you can also rely on setuptools' discovery methods
2024-09-05T03:35:12,811           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-09-05T03:35:12,811           instead of `find_packages(...)`/`find:`).

2024-09-05T03:35:12,811           You can read more about "package discovery" on setuptools documentation page:

2024-09-05T03:35:12,811           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-09-05T03:35:12,811           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-09-05T03:35:12,812           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-09-05T03:35:12,812           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-09-05T03:35:12,812           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-09-05T03:35:12,812           combination with a more fine grained `package-data` configuration.

2024-09-05T03:35:12,812           You can read more about "package data files" on setuptools documentation page:

2024-09-05T03:35:12,812           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-09-05T03:35:12,813           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-09-05T03:35:12,813                 even if it does not contain any `.py` files.
2024-09-05T03:35:12,813                 On the other hand, currently there is no concept of package data
2024-09-05T03:35:12,813                 directory, all directories are treated like packages.
2024-09-05T03:35:12,813           ********************************************************************************

2024-09-05T03:35:12,814   !!
2024-09-05T03:35:12,814     check.warn(importable)
2024-09-05T03:35:12,814   creating build/lib/deepspeed/autotuning/config_templates
2024-09-05T03:35:12,814   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-09-05T03:35:12,814   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-09-05T03:35:12,815   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-09-05T03:35:12,817   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-09-05T03:35:12,818   creating build/lib/deepspeed/ops/csrc
2024-09-05T03:35:12,819   creating build/lib/deepspeed/ops/csrc/adagrad
2024-09-05T03:35:12,820   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-09-05T03:35:12,822   creating build/lib/deepspeed/ops/csrc/adam
2024-09-05T03:35:12,823   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-09-05T03:35:12,825   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-09-05T03:35:12,827   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-09-05T03:35:12,829   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-09-05T03:35:12,832   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-09-05T03:35:12,834   creating build/lib/deepspeed/ops/csrc/aio
2024-09-05T03:35:12,835   creating build/lib/deepspeed/ops/csrc/aio/common
2024-09-05T03:35:12,836   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-09-05T03:35:12,838   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-09-05T03:35:12,840   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-09-05T03:35:12,842   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-09-05T03:35:12,844   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-09-05T03:35:12,847   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-09-05T03:35:12,849   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,849   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,852   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,854   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,855   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,857   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,859   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,862   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,863   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,866   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,868   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,869   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,871   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,873   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,876   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,878   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,880   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,882   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:12,884   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-09-05T03:35:12,885   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-09-05T03:35:12,887   creating build/lib/deepspeed/ops/csrc/cpu
2024-09-05T03:35:12,888   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-09-05T03:35:12,889   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-09-05T03:35:12,891   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:12,892   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:12,895   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:12,898   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:12,900   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:12,903   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-09-05T03:35:12,904   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-09-05T03:35:12,906   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-09-05T03:35:12,907   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:12,908   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:12,911   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:12,913   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:12,916   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:12,919   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:12,923   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:12,927   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:12,928   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:12,931   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:12,934   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:12,937   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:12,940   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:12,941   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:12,944   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:12,947   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:12,950   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:12,953   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:12,956   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:12,959   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:12,964   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:12,965   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:12,969   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:12,971   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:12,976   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:12,979   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:12,984   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:12,986   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:12,989   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-09-05T03:35:12,990   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-09-05T03:35:12,993   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-09-05T03:35:12,995   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-09-05T03:35:12,996   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-09-05T03:35:12,999   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-09-05T03:35:13,002   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-09-05T03:35:13,003   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-09-05T03:35:13,005   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-09-05T03:35:13,008   creating build/lib/deepspeed/ops/csrc/gds
2024-09-05T03:35:13,009   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:13,010   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:13,013   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:13,015   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:13,018   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:13,020   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:13,023   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:13,026   creating build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,027   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,029   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,031   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,034   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,036   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,038   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,042   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,044   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,047   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,049   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,051   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,055   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,057   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,060   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,062   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,064   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,067   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,069   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,072   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,074   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,077   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,080   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,083   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,085   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,088   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,091   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,093   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,096   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,098   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-09-05T03:35:13,101   creating build/lib/deepspeed/ops/csrc/lamb
2024-09-05T03:35:13,102   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-09-05T03:35:13,105   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-09-05T03:35:13,108   creating build/lib/deepspeed/ops/csrc/lion
2024-09-05T03:35:13,109   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-09-05T03:35:13,112   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-09-05T03:35:13,114   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-09-05T03:35:13,117   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-09-05T03:35:13,119   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-09-05T03:35:13,123   creating build/lib/deepspeed/ops/csrc/quantization
2024-09-05T03:35:13,124   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-09-05T03:35:13,126   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-09-05T03:35:13,130   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-09-05T03:35:13,133   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-09-05T03:35:13,136   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-09-05T03:35:13,139   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-09-05T03:35:13,142   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-09-05T03:35:13,144   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:13,146   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:13,148   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:13,151   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:13,154   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:13,156   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-09-05T03:35:13,157   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-09-05T03:35:13,160   creating build/lib/deepspeed/ops/csrc/spatial
2024-09-05T03:35:13,161   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-09-05T03:35:13,162   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-09-05T03:35:13,165   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-09-05T03:35:13,167   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-09-05T03:35:13,168   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-09-05T03:35:13,171   creating build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,172   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,175   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,178   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,182   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,185   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,188   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,192   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,195   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-09-05T03:35:13,198   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-09-05T03:35:13,198   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,199   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,202   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,204   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,207   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,210   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,212   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,217   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,219   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,221   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,224   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:13,227   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-09-05T03:35:13,228   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-09-05T03:35:13,231   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-09-05T03:35:13,234   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-09-05T03:35:13,236   creating build/lib/deepspeed/ops/csrc/utils
2024-09-05T03:35:13,237   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-09-05T03:35:13,239   creating build/lib/deepspeed/ops/csrc/xpu
2024-09-05T03:35:13,239   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-09-05T03:35:13,240   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-09-05T03:35:13,243   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-09-05T03:35:13,244   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-09-05T03:35:13,246   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-09-05T03:35:13,248   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-09-05T03:35:13,251   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-09-05T03:35:13,252   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-09-05T03:35:13,254   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:13,255   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:13,257   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:13,259   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:13,262   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:13,264   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:13,267   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-09-05T03:35:13,267   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-09-05T03:35:13,270   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-09-05T03:35:13,270   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-09-05T03:35:13,273   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-09-05T03:35:13,275   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-09-05T03:35:13,275   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-09-05T03:35:13,278   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:13,278   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:13,280   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:13,283   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:13,285   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:13,288   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:13,291   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-09-05T03:35:13,293   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-09-05T03:35:13,294   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-09-05T03:35:13,296   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-09-05T03:35:13,297   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-09-05T03:35:13,299   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-09-05T03:35:13,301   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-09-05T03:35:13,303   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-09-05T03:35:13,305   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-09-05T03:35:13,306   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-09-05T03:35:13,308   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-09-05T03:35:13,310   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:13,313   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:13,315   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:13,317   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:13,319   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:13,322   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:13,323   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:13,326   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:13,327   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:13,329   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:13,331   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:13,334   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:13,335   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:13,338   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:13,340   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:13,343   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:13,345   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:13,347   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:13,349   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:13,352   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:13,354   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:13,356   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:13,358   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:13,361   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:13,363   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:13,364   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:13,367   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:13,369   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:13,371   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:13,373   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:13,375   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:13,377   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:13,379   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:13,382   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:13,384   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:13,386   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:13,388   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:13,391   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:13,394   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:13,396   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:13,398   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:13,400   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:13,403   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:13,405   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:13,407   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:13,409   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:13,411   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:13,413   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:13,416   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:13,418   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:13,420   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:13,423   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:13,424   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:13,427   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:13,429   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,430   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,432   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,435   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,437   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,439   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,442   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,444   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,446   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,448   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:13,451   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:13,453   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:13,455   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:13,518   running build_scripts
2024-09-05T03:35:13,518   creating build/scripts-3.9
2024-09-05T03:35:13,519   copying and adjusting bin/deepspeed -> build/scripts-3.9
2024-09-05T03:35:13,521   copying and adjusting bin/deepspeed.pt -> build/scripts-3.9
2024-09-05T03:35:13,522   copying and adjusting bin/ds -> build/scripts-3.9
2024-09-05T03:35:13,524   copying bin/ds_ssh -> build/scripts-3.9
2024-09-05T03:35:13,526   copying and adjusting bin/ds_report -> build/scripts-3.9
2024-09-05T03:35:13,527   copying and adjusting bin/ds_bench -> build/scripts-3.9
2024-09-05T03:35:13,528   copying and adjusting bin/dsr -> build/scripts-3.9
2024-09-05T03:35:13,530   copying and adjusting bin/ds_elastic -> build/scripts-3.9
2024-09-05T03:35:13,531   changing mode of build/scripts-3.9/deepspeed from 644 to 755
2024-09-05T03:35:13,531   changing mode of build/scripts-3.9/deepspeed.pt from 644 to 755
2024-09-05T03:35:13,531   changing mode of build/scripts-3.9/ds from 644 to 755
2024-09-05T03:35:13,532   changing mode of build/scripts-3.9/ds_report from 644 to 755
2024-09-05T03:35:13,532   changing mode of build/scripts-3.9/ds_bench from 644 to 755
2024-09-05T03:35:13,533   changing mode of build/scripts-3.9/dsr from 644 to 755
2024-09-05T03:35:13,533   changing mode of build/scripts-3.9/ds_elastic from 644 to 755
2024-09-05T03:35:13,559   /usr/local/lib/python3.9/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-09-05T03:35:13,559   !!

2024-09-05T03:35:13,560           ********************************************************************************
2024-09-05T03:35:13,560           Please avoid running ``setup.py`` directly.
2024-09-05T03:35:13,560           Instead, use pypa/build, pypa/installer or other
2024-09-05T03:35:13,560           standards-based tools.

2024-09-05T03:35:13,560           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-09-05T03:35:13,560           ********************************************************************************

2024-09-05T03:35:13,561   !!
2024-09-05T03:35:13,561     self.initialize_options()
2024-09-05T03:35:13,585   installing to build/bdist.linux-armv7l/wheel
2024-09-05T03:35:13,585   running install
2024-09-05T03:35:13,610   running install_lib
2024-09-05T03:35:13,637   creating build/bdist.linux-armv7l
2024-09-05T03:35:13,637   creating build/bdist.linux-armv7l/wheel
2024-09-05T03:35:13,639   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-09-05T03:35:13,641   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-09-05T03:35:13,642   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-09-05T03:35:13,643   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-09-05T03:35:13,646   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-09-05T03:35:13,648   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-09-05T03:35:13,650   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-09-05T03:35:13,652   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-09-05T03:35:13,654   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-09-05T03:35:13,655   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,658   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,660   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,661   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,663   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,666   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,668   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,670   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,672   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-09-05T03:35:13,675   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-09-05T03:35:13,675   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,677   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,679   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,680   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,683   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,686   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,689   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,691   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,693   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-09-05T03:35:13,695   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-09-05T03:35:13,699   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-09-05T03:35:13,700   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-09-05T03:35:13,702   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-09-05T03:35:13,705   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-09-05T03:35:13,708   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-09-05T03:35:13,710   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-09-05T03:35:13,713   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-09-05T03:35:13,716   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-09-05T03:35:13,719   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-09-05T03:35:13,722   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-09-05T03:35:13,723   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-09-05T03:35:13,725   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-09-05T03:35:13,727   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-09-05T03:35:13,729   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-09-05T03:35:13,731   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-09-05T03:35:13,734   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-09-05T03:35:13,735   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-09-05T03:35:13,737   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-09-05T03:35:13,740   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-09-05T03:35:13,741   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-09-05T03:35:13,744   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-09-05T03:35:13,745   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,748   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,750   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,752   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,755   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,758   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,760   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,762   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,763   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,766   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,768   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,770   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,773   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,776   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,779   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,781   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,783   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,785   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-09-05T03:35:13,787   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-09-05T03:35:13,788   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-09-05T03:35:13,790   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-09-05T03:35:13,791   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-09-05T03:35:13,793   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-09-05T03:35:13,796   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-09-05T03:35:13,798   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-09-05T03:35:13,800   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-09-05T03:35:13,801   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,803   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,808   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-09-05T03:35:13,809   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-09-05T03:35:13,810   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-09-05T03:35:13,813   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-09-05T03:35:13,815   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-09-05T03:35:13,817   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-09-05T03:35:13,819   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-09-05T03:35:13,821   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,824   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-09-05T03:35:13,825   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:13,826   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:13,828   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:13,830   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:13,832   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:13,833   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-09-05T03:35:13,835   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-09-05T03:35:13,838   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-09-05T03:35:13,840   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:13,840   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:13,843   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:13,845   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:13,846   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:13,849   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-09-05T03:35:13,852   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-09-05T03:35:13,854   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-09-05T03:35:13,856   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,857   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,860   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-09-05T03:35:13,861   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-09-05T03:35:13,864   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-09-05T03:35:13,866   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-09-05T03:35:13,868   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-09-05T03:35:13,869   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-09-05T03:35:13,871   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-09-05T03:35:13,872   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,875   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,877   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-09-05T03:35:13,878   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-09-05T03:35:13,881   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-09-05T03:35:13,884   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-09-05T03:35:13,886   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-09-05T03:35:13,887   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-09-05T03:35:13,890   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-09-05T03:35:13,892   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,894   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,897   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,900   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-09-05T03:35:13,900   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-09-05T03:35:13,902   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-09-05T03:35:13,904   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-09-05T03:35:13,907   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-09-05T03:35:13,908   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-09-05T03:35:13,910   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-09-05T03:35:13,913   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-09-05T03:35:13,915   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-09-05T03:35:13,918   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-09-05T03:35:13,920   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,922   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,924   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,927   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-09-05T03:35:13,928   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,930   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,932   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,936   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,938   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,940   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,943   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,947   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,949   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,951   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,953   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,955   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,957   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,959   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,962   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,966   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-09-05T03:35:13,969   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,970   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,972   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,974   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,975   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,978   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,980   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,983   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,986   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,988   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-09-05T03:35:13,990   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,992   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,994   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:13,997   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:13,997   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:13,999   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:14,001   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:14,003   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-09-05T03:35:14,005   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:14,008   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-09-05T03:35:14,011   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-09-05T03:35:14,013   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-09-05T03:35:14,014   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,016   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-09-05T03:35:14,017   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,019   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,022   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,023   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,026   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,028   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,030   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,031   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,033   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,035   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,037   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,039   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,041   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,043   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,045   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,047   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,050   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-09-05T03:35:14,051   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-09-05T03:35:14,053   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-09-05T03:35:14,055   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-09-05T03:35:14,056   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-09-05T03:35:14,058   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-09-05T03:35:14,060   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-09-05T03:35:14,062   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-09-05T03:35:14,064   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,066   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,068   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-09-05T03:35:14,070   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,072   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,073   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,075   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,077   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,080   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,082   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,084   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,087   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,089   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,091   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,094   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-09-05T03:35:14,096   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-09-05T03:35:14,097   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-09-05T03:35:14,099   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-09-05T03:35:14,101   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-09-05T03:35:14,103   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-09-05T03:35:14,104   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-09-05T03:35:14,105   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,107   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,109   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,110   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,112   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,114   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,115   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,117   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,119   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,121   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-09-05T03:35:14,123   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-09-05T03:35:14,125   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-09-05T03:35:14,125   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-09-05T03:35:14,127   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-09-05T03:35:14,129   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-09-05T03:35:14,132   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-09-05T03:35:14,133   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-09-05T03:35:14,134   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-09-05T03:35:14,136   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-09-05T03:35:14,137   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-09-05T03:35:14,140   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-09-05T03:35:14,142   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-09-05T03:35:14,143   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-09-05T03:35:14,145   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-09-05T03:35:14,147   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-09-05T03:35:14,149   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-09-05T03:35:14,151   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-09-05T03:35:14,154   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-09-05T03:35:14,154   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,157   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,159   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-09-05T03:35:14,160   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-09-05T03:35:14,161   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-09-05T03:35:14,163   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-09-05T03:35:14,165   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-09-05T03:35:14,167   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-09-05T03:35:14,170   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-09-05T03:35:14,171   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-09-05T03:35:14,172   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-09-05T03:35:14,174   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-09-05T03:35:14,176   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-09-05T03:35:14,178   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-09-05T03:35:14,180   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-09-05T03:35:14,182   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,184   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,186   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,187   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,189   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,191   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,194   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-09-05T03:35:14,195   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:14,196   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:14,198   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:14,199   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:14,201   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-09-05T03:35:14,204   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:14,205   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:14,206   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:14,208   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:14,210   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-09-05T03:35:14,212   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-09-05T03:35:14,214   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:14,215   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:14,217   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:14,219   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:14,221   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-09-05T03:35:14,223   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:14,224   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:14,226   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:14,228   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:14,229   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-09-05T03:35:14,232   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,233   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,235   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,237   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,238   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,240   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,242   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,244   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,246   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,247   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-09-05T03:35:14,250   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:14,251   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:14,253   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:14,254   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:14,256   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-09-05T03:35:14,259   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:14,260   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:14,262   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:14,263   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:14,265   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-09-05T03:35:14,268   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:14,269   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:14,271   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:14,273   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:14,274   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-09-05T03:35:14,277   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-09-05T03:35:14,279   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-09-05T03:35:14,282   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-09-05T03:35:14,284   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-09-05T03:35:14,287   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:14,287   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:14,289   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:14,291   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:14,293   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-09-05T03:35:14,295   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-09-05T03:35:14,298   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:14,298   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:14,300   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:14,302   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:14,304   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-09-05T03:35:14,307   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,308   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,310   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,312   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,314   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,316   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,317   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,319   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,321   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,323   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-09-05T03:35:14,325   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-09-05T03:35:14,328   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:14,329   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:14,330   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:14,332   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:14,334   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-09-05T03:35:14,337   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-09-05T03:35:14,338   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-09-05T03:35:14,339   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-09-05T03:35:14,342   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-09-05T03:35:14,343   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-09-05T03:35:14,346   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-09-05T03:35:14,346   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-09-05T03:35:14,348   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-09-05T03:35:14,350   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,351   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,353   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,355   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,356   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,358   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,360   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,361   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,363   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-09-05T03:35:14,366   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-09-05T03:35:14,366   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-09-05T03:35:14,368   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-09-05T03:35:14,370   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-09-05T03:35:14,372   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-09-05T03:35:14,373   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-09-05T03:35:14,375   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-09-05T03:35:14,377   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-09-05T03:35:14,379   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-09-05T03:35:14,381   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-09-05T03:35:14,384   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-09-05T03:35:14,385   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-09-05T03:35:14,386   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-09-05T03:35:14,388   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-09-05T03:35:14,390   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-09-05T03:35:14,393   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-09-05T03:35:14,393   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-09-05T03:35:14,395   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-09-05T03:35:14,397   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-09-05T03:35:14,399   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-09-05T03:35:14,400   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-09-05T03:35:14,403   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-09-05T03:35:14,405   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-09-05T03:35:14,406   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-09-05T03:35:14,409   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-09-05T03:35:14,411   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-09-05T03:35:14,412   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-09-05T03:35:14,414   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-09-05T03:35:14,416   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-09-05T03:35:14,417   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-09-05T03:35:14,419   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-09-05T03:35:14,422   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-09-05T03:35:14,423   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-09-05T03:35:14,425   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-09-05T03:35:14,427   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-09-05T03:35:14,429   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-09-05T03:35:14,430   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:14,431   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:14,433   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:14,436   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:14,439   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:14,440   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-09-05T03:35:14,444   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-09-05T03:35:14,445   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-09-05T03:35:14,446   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-09-05T03:35:14,448   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,449   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,451   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,453   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,455   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,456   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,459   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,461   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,463   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-09-05T03:35:14,466   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-09-05T03:35:14,467   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-09-05T03:35:14,468   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-09-05T03:35:14,470   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-09-05T03:35:14,472   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-09-05T03:35:14,474   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:14,475   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:14,476   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:14,478   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:14,480   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-09-05T03:35:14,482   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:14,483   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:14,485   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:14,486   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:14,488   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:14,490   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:14,492   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-09-05T03:35:14,494   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:14,495   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:14,497   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:14,499   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:14,501   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:14,503   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:14,505   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-09-05T03:35:14,508   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:14,509   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:14,511   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:14,513   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:14,514   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:14,516   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:14,518   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-09-05T03:35:14,520   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:14,521   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:14,523   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:14,525   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:14,527   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:14,529   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:14,531   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-09-05T03:35:14,533   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:14,534   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:14,535   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:14,537   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:14,539   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:14,542   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:14,544   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-09-05T03:35:14,546   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-09-05T03:35:14,548   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:14,549   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:14,551   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:14,553   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:14,555   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:14,557   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:14,559   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-09-05T03:35:14,560   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-09-05T03:35:14,562   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-09-05T03:35:14,563   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-09-05T03:35:14,566   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:14,566   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:14,568   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:14,570   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:14,572   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:14,574   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-09-05T03:35:14,575   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-09-05T03:35:14,577   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:14,578   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:14,580   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:14,582   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:14,584   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:14,586   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:14,587   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-09-05T03:35:14,590   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-09-05T03:35:14,591   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-09-05T03:35:14,594   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-09-05T03:35:14,595   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-09-05T03:35:14,597   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-09-05T03:35:14,599   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:14,600   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:14,603   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:14,604   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:14,606   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-09-05T03:35:14,609   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:14,610   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:14,611   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:14,613   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:14,615   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:14,617   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-09-05T03:35:14,619   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:14,620   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:14,622   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:14,624   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:14,626   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:14,628   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:14,630   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:14,631   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-09-05T03:35:14,634   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:14,635   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:14,637   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:14,639   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:14,641   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:14,643   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-09-05T03:35:14,645   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,646   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,648   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,650   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,652   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,654   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,655   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,657   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,660   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-09-05T03:35:14,662   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:14,663   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:14,666   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:14,667   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:14,669   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:14,671   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:14,674   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-09-05T03:35:14,676   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,677   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,679   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,681   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,683   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,685   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,688   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,689   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,691   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,694   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-09-05T03:35:14,696   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-09-05T03:35:14,698   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-09-05T03:35:14,700   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-09-05T03:35:14,702   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-09-05T03:35:14,703   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-09-05T03:35:14,706   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-09-05T03:35:14,708   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-09-05T03:35:14,709   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-09-05T03:35:14,712   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-09-05T03:35:14,714   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-09-05T03:35:14,716   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-09-05T03:35:14,717   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-09-05T03:35:14,720   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-09-05T03:35:14,722   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-09-05T03:35:14,725   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-09-05T03:35:14,728   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-09-05T03:35:14,729   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-09-05T03:35:14,731   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-09-05T03:35:14,733   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-09-05T03:35:14,734   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-09-05T03:35:14,736   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-09-05T03:35:14,738   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-09-05T03:35:14,740   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-09-05T03:35:14,741   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-09-05T03:35:14,743   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-09-05T03:35:14,745   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-09-05T03:35:14,746   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-09-05T03:35:14,748   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-09-05T03:35:14,750   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-09-05T03:35:14,753   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-09-05T03:35:14,755   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-09-05T03:35:14,755   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-09-05T03:35:14,757   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-09-05T03:35:14,759   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-09-05T03:35:14,760   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-09-05T03:35:14,762   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-09-05T03:35:14,764   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-09-05T03:35:14,765   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-09-05T03:35:14,767   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-09-05T03:35:14,770   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-09-05T03:35:14,771   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,774   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,775   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,778   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,779   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,781   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,782   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,784   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,790   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,792   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,794   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,796   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,798   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,800   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,802   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,805   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-09-05T03:35:14,807   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,809   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,810   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,812   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,814   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,816   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,818   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,820   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,822   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,824   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,826   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,827   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-09-05T03:35:14,829   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,832   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,834   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,836   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-09-05T03:35:14,838   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-09-05T03:35:14,839   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-09-05T03:35:14,842   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-09-05T03:35:14,843   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-09-05T03:35:14,846   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-09-05T03:35:14,848   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-09-05T03:35:14,849   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-09-05T03:35:14,850   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-09-05T03:35:14,853   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-09-05T03:35:14,855   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-09-05T03:35:14,857   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-09-05T03:35:14,860   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-09-05T03:35:14,863   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:14,864   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:14,866   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:14,867   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:14,870   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-09-05T03:35:14,871   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-09-05T03:35:14,874   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-09-05T03:35:14,875   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-09-05T03:35:14,877   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-09-05T03:35:14,880   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-09-05T03:35:14,881   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-09-05T03:35:14,882   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,884   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,886   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,888   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,890   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,892   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,893   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,895   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,897   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,899   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,902   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,904   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,906   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,908   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,910   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,912   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,914   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,917   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,919   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,921   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,923   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,925   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,928   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,930   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,931   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,933   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,935   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,936   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,938   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-09-05T03:35:14,941   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-09-05T03:35:14,942   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-09-05T03:35:14,945   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-09-05T03:35:14,946   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-09-05T03:35:14,950   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-09-05T03:35:14,952   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-09-05T03:35:14,955   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-09-05T03:35:14,957   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-09-05T03:35:14,959   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-09-05T03:35:14,960   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-09-05T03:35:14,962   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-09-05T03:35:14,965   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-09-05T03:35:14,968   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,968   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,970   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,972   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,975   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,977   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,979   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,982   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,984   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,986   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,989   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-09-05T03:35:14,993   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-09-05T03:35:14,995   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-09-05T03:35:14,998   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-09-05T03:35:15,000   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-09-05T03:35:15,004   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-09-05T03:35:15,005   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-09-05T03:35:15,006   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-09-05T03:35:15,009   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-09-05T03:35:15,010   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-09-05T03:35:15,012   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-09-05T03:35:15,016   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-09-05T03:35:15,016   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-09-05T03:35:15,019   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-09-05T03:35:15,020   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-09-05T03:35:15,023   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-09-05T03:35:15,025   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-09-05T03:35:15,026   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-09-05T03:35:15,028   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-09-05T03:35:15,029   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:15,031   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:15,032   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:15,034   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:15,036   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:15,038   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-09-05T03:35:15,041   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:15,043   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:15,045   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:15,047   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:15,048   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:15,053   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:15,055   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:15,057   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:15,060   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:15,062   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:15,066   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-09-05T03:35:15,068   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:15,072   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:15,076   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-09-05T03:35:15,077   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-09-05T03:35:15,079   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-09-05T03:35:15,082   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-09-05T03:35:15,085   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:15,086   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:15,088   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:15,091   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:15,094   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:15,097   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:15,099   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:15,102   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-09-05T03:35:15,106   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-09-05T03:35:15,107   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:15,108   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:15,110   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:15,113   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:15,115   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:15,117   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-09-05T03:35:15,120   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-09-05T03:35:15,121   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-09-05T03:35:15,124   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-09-05T03:35:15,125   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-09-05T03:35:15,127   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-09-05T03:35:15,129   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-09-05T03:35:15,131   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-09-05T03:35:15,132   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-09-05T03:35:15,135   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-09-05T03:35:15,137   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-09-05T03:35:15,139   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2024-09-05T03:35:15,141   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:15,142   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:15,144   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:15,147   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:15,149   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:15,151   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:15,153   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2024-09-05T03:35:15,156   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-09-05T03:35:15,157   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-09-05T03:35:15,160   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-09-05T03:35:15,162   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-09-05T03:35:15,164   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-09-05T03:35:15,166   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-09-05T03:35:15,169   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-09-05T03:35:15,171   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-09-05T03:35:15,172   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-09-05T03:35:15,174   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-09-05T03:35:15,176   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-09-05T03:35:15,178   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-09-05T03:35:15,181   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:15,182   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:15,184   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:15,187   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:15,189   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-09-05T03:35:15,191   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-09-05T03:35:15,192   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:15,193   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:15,195   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:15,197   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:15,199   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-09-05T03:35:15,202   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-09-05T03:35:15,203   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-09-05T03:35:15,205   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-09-05T03:35:15,206   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-09-05T03:35:15,208   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-09-05T03:35:15,209   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-09-05T03:35:15,211   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-09-05T03:35:15,213   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-09-05T03:35:15,215   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-09-05T03:35:15,217   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-09-05T03:35:15,219   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-09-05T03:35:15,220   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-09-05T03:35:15,222   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-09-05T03:35:15,224   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-09-05T03:35:15,226   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-09-05T03:35:15,229   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-09-05T03:35:15,231   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-09-05T03:35:15,233   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-09-05T03:35:15,236   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-09-05T03:35:15,237   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,238   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,240   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,242   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,244   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,245   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,247   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,248   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,250   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,252   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,254   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,255   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,257   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,259   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,260   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,262   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,264   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,266   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-09-05T03:35:15,268   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-09-05T03:35:15,269   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-09-05T03:35:15,271   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-09-05T03:35:15,274   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-09-05T03:35:15,275   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-09-05T03:35:15,277   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-09-05T03:35:15,278   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-09-05T03:35:15,281   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-09-05T03:35:15,282   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-09-05T03:35:15,284   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-09-05T03:35:15,285   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-09-05T03:35:15,286   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-09-05T03:35:15,289   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2024-09-05T03:35:15,290   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2024-09-05T03:35:15,292   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-09-05T03:35:15,293   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-09-05T03:35:15,295   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-09-05T03:35:15,296   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-09-05T03:35:15,299   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-09-05T03:35:15,301   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-09-05T03:35:15,302   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-09-05T03:35:15,303   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-09-05T03:35:15,306   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-09-05T03:35:15,307   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,309   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,310   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,312   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,314   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,315   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,317   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,319   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,321   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,322   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,324   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,326   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,328   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,329   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,331   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,332   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,334   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,335   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,337   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,340   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,341   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,343   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-09-05T03:35:15,344   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,346   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,347   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,349   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,351   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,352   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,354   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,355   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,357   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,358   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,360   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,362   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-09-05T03:35:15,364   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,366   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-09-05T03:35:15,367   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-09-05T03:35:15,369   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-09-05T03:35:15,370   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-09-05T03:35:15,372   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-09-05T03:35:15,374   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-09-05T03:35:15,375   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,377   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,378   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,380   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,382   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,384   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-09-05T03:35:15,385   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-09-05T03:35:15,387   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-09-05T03:35:15,388   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-09-05T03:35:15,390   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-09-05T03:35:15,391   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-09-05T03:35:15,393   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-09-05T03:35:15,394   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,396   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,398   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,399   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,402   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-09-05T03:35:15,404   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-09-05T03:35:15,405   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-09-05T03:35:15,407   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-09-05T03:35:15,408   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-09-05T03:35:15,410   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-09-05T03:35:15,413   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-09-05T03:35:15,414   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-09-05T03:35:15,416   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-09-05T03:35:15,417   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,419   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,422   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,423   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,425   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,427   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,429   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,431   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,434   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,436   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-09-05T03:35:15,437   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-09-05T03:35:15,439   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-09-05T03:35:15,440   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-09-05T03:35:15,442   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-09-05T03:35:15,444   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-09-05T03:35:15,447   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-09-05T03:35:15,448   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-09-05T03:35:15,450   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-09-05T03:35:15,452   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-09-05T03:35:15,455   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-09-05T03:35:15,456   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-09-05T03:35:15,457   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-09-05T03:35:15,459   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-09-05T03:35:15,462   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-09-05T03:35:15,463   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-09-05T03:35:15,465   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-09-05T03:35:15,466   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-09-05T03:35:15,469   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-09-05T03:35:15,471   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-09-05T03:35:15,472   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-09-05T03:35:15,474   running install_egg_info
2024-09-05T03:35:15,505   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.15.1-py3.9.egg-info
2024-09-05T03:35:15,519   running install_scripts
2024-09-05T03:35:15,520   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data
2024-09-05T03:35:15,521   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,522   copying build/scripts-3.9/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,523   copying build/scripts-3.9/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,525   copying build/scripts-3.9/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,527   copying build/scripts-3.9/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,528   copying build/scripts-3.9/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,530   copying build/scripts-3.9/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,531   copying build/scripts-3.9/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,533   copying build/scripts-3.9/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts
2024-09-05T03:35:15,534   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts/deepspeed to 755
2024-09-05T03:35:15,535   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts/ds_report to 755
2024-09-05T03:35:15,535   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts/ds to 755
2024-09-05T03:35:15,535   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts/ds_elastic to 755
2024-09-05T03:35:15,536   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts/ds_ssh to 755
2024-09-05T03:35:15,536   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts/dsr to 755
2024-09-05T03:35:15,536   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts/deepspeed.pt to 755
2024-09-05T03:35:15,537   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.data/scripts/ds_bench to 755
2024-09-05T03:35:15,600   creating build/bdist.linux-armv7l/wheel/deepspeed-0.15.1.dist-info/WHEEL
2024-09-05T03:35:15,603   creating '/tmp/pip-wheel-6gfqk__c/deepspeed-0.15.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-09-05T03:35:15,606   adding 'deepspeed/__init__.py'
2024-09-05T03:35:15,607   adding 'deepspeed/constants.py'
2024-09-05T03:35:15,609   adding 'deepspeed/env_report.py'
2024-09-05T03:35:15,610   adding 'deepspeed/git_version_info.py'
2024-09-05T03:35:15,611   adding 'deepspeed/git_version_info_installed.py'
2024-09-05T03:35:15,613   adding 'deepspeed/accelerator/__init__.py'
2024-09-05T03:35:15,615   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-09-05T03:35:15,616   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-09-05T03:35:15,618   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-09-05T03:35:15,620   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-09-05T03:35:15,622   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-09-05T03:35:15,624   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-09-05T03:35:15,625   adding 'deepspeed/accelerator/real_accelerator.py'
2024-09-05T03:35:15,627   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-09-05T03:35:15,629   adding 'deepspeed/autotuning/__init__.py'
2024-09-05T03:35:15,634   adding 'deepspeed/autotuning/autotuner.py'
2024-09-05T03:35:15,636   adding 'deepspeed/autotuning/config.py'
2024-09-05T03:35:15,637   adding 'deepspeed/autotuning/constants.py'
2024-09-05T03:35:15,640   adding 'deepspeed/autotuning/scheduler.py'
2024-09-05T03:35:15,642   adding 'deepspeed/autotuning/utils.py'
2024-09-05T03:35:15,644   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-09-05T03:35:15,645   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-09-05T03:35:15,646   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-09-05T03:35:15,647   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-09-05T03:35:15,649   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-09-05T03:35:15,650   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-09-05T03:35:15,652   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-09-05T03:35:15,653   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-09-05T03:35:15,655   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-09-05T03:35:15,656   adding 'deepspeed/autotuning/tuner/utils.py'
2024-09-05T03:35:15,658   adding 'deepspeed/checkpoint/__init__.py'
2024-09-05T03:35:15,659   adding 'deepspeed/checkpoint/constants.py'
2024-09-05T03:35:15,661   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-09-05T03:35:15,664   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-09-05T03:35:15,666   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-09-05T03:35:15,668   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-09-05T03:35:15,669   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-09-05T03:35:15,671   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-09-05T03:35:15,672   adding 'deepspeed/checkpoint/utils.py'
2024-09-05T03:35:15,674   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-09-05T03:35:15,675   adding 'deepspeed/comm/__init__.py'
2024-09-05T03:35:15,676   adding 'deepspeed/comm/backend.py'
2024-09-05T03:35:15,678   adding 'deepspeed/comm/ccl.py'
2024-09-05T03:35:15,681   adding 'deepspeed/comm/comm.py'
2024-09-05T03:35:15,683   adding 'deepspeed/comm/config.py'
2024-09-05T03:35:15,684   adding 'deepspeed/comm/constants.py'
2024-09-05T03:35:15,685   adding 'deepspeed/comm/reduce_op.py'
2024-09-05T03:35:15,687   adding 'deepspeed/comm/torch.py'
2024-09-05T03:35:15,689   adding 'deepspeed/comm/utils.py'
2024-09-05T03:35:15,690   adding 'deepspeed/compression/__init__.py'
2024-09-05T03:35:15,694   adding 'deepspeed/compression/basic_layer.py'
2024-09-05T03:35:15,696   adding 'deepspeed/compression/compress.py'
2024-09-05T03:35:15,699   adding 'deepspeed/compression/config.py'
2024-09-05T03:35:15,701   adding 'deepspeed/compression/constants.py'
2024-09-05T03:35:15,703   adding 'deepspeed/compression/helper.py'
2024-09-05T03:35:15,704   adding 'deepspeed/compression/scheduler.py'
2024-09-05T03:35:15,706   adding 'deepspeed/compression/utils.py'
2024-09-05T03:35:15,708   adding 'deepspeed/elasticity/__init__.py'
2024-09-05T03:35:15,709   adding 'deepspeed/elasticity/config.py'
2024-09-05T03:35:15,710   adding 'deepspeed/elasticity/constants.py'
2024-09-05T03:35:15,712   adding 'deepspeed/elasticity/elastic_agent.py'
2024-09-05T03:35:15,714   adding 'deepspeed/elasticity/elasticity.py'
2024-09-05T03:35:15,716   adding 'deepspeed/elasticity/utils.py'
2024-09-05T03:35:15,717   adding 'deepspeed/inference/__init__.py'
2024-09-05T03:35:15,719   adding 'deepspeed/inference/config.py'
2024-09-05T03:35:15,723   adding 'deepspeed/inference/engine.py'
2024-09-05T03:35:15,725   adding 'deepspeed/inference/quantization/__init__.py'
2024-09-05T03:35:15,727   adding 'deepspeed/inference/quantization/layers.py'
2024-09-05T03:35:15,728   adding 'deepspeed/inference/quantization/quantization.py'
2024-09-05T03:35:15,729   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-09-05T03:35:15,731   adding 'deepspeed/inference/quantization/utils.py'
2024-09-05T03:35:15,733   adding 'deepspeed/inference/v2/__init__.py'
2024-09-05T03:35:15,735   adding 'deepspeed/inference/v2/allocator.py'
2024-09-05T03:35:15,736   adding 'deepspeed/inference/v2/config_v2.py'
2024-09-05T03:35:15,738   adding 'deepspeed/inference/v2/engine_factory.py'
2024-09-05T03:35:15,740   adding 'deepspeed/inference/v2/engine_v2.py'
2024-09-05T03:35:15,742   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-09-05T03:35:15,743   adding 'deepspeed/inference/v2/inference_utils.py'
2024-09-05T03:35:15,745   adding 'deepspeed/inference/v2/logging.py'
2024-09-05T03:35:15,746   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-09-05T03:35:15,747   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-09-05T03:35:15,749   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-09-05T03:35:15,750   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-09-05T03:35:15,751   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-09-05T03:35:15,753   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-09-05T03:35:15,754   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-09-05T03:35:15,756   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-09-05T03:35:15,757   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-09-05T03:35:15,759   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-09-05T03:35:15,760   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-09-05T03:35:15,762   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-09-05T03:35:15,763   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-09-05T03:35:15,765   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-09-05T03:35:15,766   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-09-05T03:35:15,768   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-09-05T03:35:15,769   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-09-05T03:35:15,771   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-09-05T03:35:15,773   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-09-05T03:35:15,779   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-09-05T03:35:15,780   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-09-05T03:35:15,782   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-09-05T03:35:15,783   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-09-05T03:35:15,784   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-09-05T03:35:15,786   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-09-05T03:35:15,788   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-09-05T03:35:15,790   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-09-05T03:35:15,792   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-09-05T03:35:15,794   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-09-05T03:35:15,795   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-09-05T03:35:15,797   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-09-05T03:35:15,798   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-09-05T03:35:15,800   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-09-05T03:35:15,802   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-09-05T03:35:15,804   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-09-05T03:35:15,805   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-09-05T03:35:15,807   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-09-05T03:35:15,808   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-09-05T03:35:15,810   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-09-05T03:35:15,811   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-09-05T03:35:15,813   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-09-05T03:35:15,815   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-09-05T03:35:15,816   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-09-05T03:35:15,818   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-09-05T03:35:15,819   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-09-05T03:35:15,820   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-09-05T03:35:15,822   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-09-05T03:35:15,823   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-09-05T03:35:15,825   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-09-05T03:35:15,826   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-09-05T03:35:15,827   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-09-05T03:35:15,829   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-09-05T03:35:15,830   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-09-05T03:35:15,832   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-09-05T03:35:15,833   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-09-05T03:35:15,835   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-09-05T03:35:15,836   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-09-05T03:35:15,837   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-09-05T03:35:15,839   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-09-05T03:35:15,840   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-09-05T03:35:15,842   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-09-05T03:35:15,843   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-09-05T03:35:15,845   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-09-05T03:35:15,846   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-09-05T03:35:15,847   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-09-05T03:35:15,849   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-09-05T03:35:15,850   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-09-05T03:35:15,852   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-09-05T03:35:15,854   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-09-05T03:35:15,855   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-09-05T03:35:15,857   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-09-05T03:35:15,860   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-09-05T03:35:15,862   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-09-05T03:35:15,863   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-09-05T03:35:15,865   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-09-05T03:35:15,866   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-09-05T03:35:15,868   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-09-05T03:35:15,869   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-09-05T03:35:15,870   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-09-05T03:35:15,872   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-09-05T03:35:15,873   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-09-05T03:35:15,875   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-09-05T03:35:15,876   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-09-05T03:35:15,877   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-09-05T03:35:15,879   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-09-05T03:35:15,880   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-09-05T03:35:15,882   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-09-05T03:35:15,883   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-09-05T03:35:15,884   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-09-05T03:35:15,886   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-09-05T03:35:15,887   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-09-05T03:35:15,889   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-09-05T03:35:15,891   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-09-05T03:35:15,892   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-09-05T03:35:15,894   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-09-05T03:35:15,895   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-09-05T03:35:15,897   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-09-05T03:35:15,898   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-09-05T03:35:15,900   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-09-05T03:35:15,902   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-09-05T03:35:15,903   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-09-05T03:35:15,904   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-09-05T03:35:15,905   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-09-05T03:35:15,907   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-09-05T03:35:15,908   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-09-05T03:35:15,910   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-09-05T03:35:15,911   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-09-05T03:35:15,912   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-09-05T03:35:15,914   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-09-05T03:35:15,915   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-09-05T03:35:15,916   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-09-05T03:35:15,918   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-09-05T03:35:15,919   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-09-05T03:35:15,921   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-09-05T03:35:15,922   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-09-05T03:35:15,923   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-09-05T03:35:15,925   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-09-05T03:35:15,927   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-09-05T03:35:15,928   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-09-05T03:35:15,929   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-09-05T03:35:15,931   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-09-05T03:35:15,932   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-09-05T03:35:15,933   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-09-05T03:35:15,934   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-09-05T03:35:15,936   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-09-05T03:35:15,937   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-09-05T03:35:15,939   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-09-05T03:35:15,941   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-09-05T03:35:15,943   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-09-05T03:35:15,945   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-09-05T03:35:15,947   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-09-05T03:35:15,949   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-09-05T03:35:15,951   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-09-05T03:35:15,953   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-09-05T03:35:15,954   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-09-05T03:35:15,956   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-09-05T03:35:15,957   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-09-05T03:35:15,958   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-09-05T03:35:15,959   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-09-05T03:35:15,961   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-09-05T03:35:15,962   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-09-05T03:35:15,963   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-09-05T03:35:15,965   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-09-05T03:35:15,966   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-09-05T03:35:15,968   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-09-05T03:35:15,969   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-09-05T03:35:15,971   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-09-05T03:35:15,972   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-09-05T03:35:15,974   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-09-05T03:35:15,975   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-09-05T03:35:15,977   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-09-05T03:35:15,978   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-09-05T03:35:15,980   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-09-05T03:35:15,981   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-09-05T03:35:15,983   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-09-05T03:35:15,984   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-09-05T03:35:15,986   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-09-05T03:35:15,987   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-09-05T03:35:15,989   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-09-05T03:35:15,990   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-09-05T03:35:15,992   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-09-05T03:35:15,993   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-09-05T03:35:15,995   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-09-05T03:35:15,996   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-09-05T03:35:15,998   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-09-05T03:35:15,999   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-09-05T03:35:16,001   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-09-05T03:35:16,002   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-09-05T03:35:16,003   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-09-05T03:35:16,005   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-09-05T03:35:16,006   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-09-05T03:35:16,008   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-09-05T03:35:16,009   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-09-05T03:35:16,011   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-09-05T03:35:16,012   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-09-05T03:35:16,014   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-09-05T03:35:16,015   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-09-05T03:35:16,017   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-09-05T03:35:16,018   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-09-05T03:35:16,019   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-09-05T03:35:16,021   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-09-05T03:35:16,023   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-09-05T03:35:16,025   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-09-05T03:35:16,026   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-09-05T03:35:16,027   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-09-05T03:35:16,029   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-09-05T03:35:16,030   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-09-05T03:35:16,032   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-09-05T03:35:16,033   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-09-05T03:35:16,034   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-09-05T03:35:16,036   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-09-05T03:35:16,038   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-09-05T03:35:16,039   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-09-05T03:35:16,040   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-09-05T03:35:16,042   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-09-05T03:35:16,044   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-09-05T03:35:16,045   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-09-05T03:35:16,046   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-09-05T03:35:16,047   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-09-05T03:35:16,049   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-09-05T03:35:16,050   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-09-05T03:35:16,051   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-09-05T03:35:16,053   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-09-05T03:35:16,055   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-09-05T03:35:16,056   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-09-05T03:35:16,058   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-09-05T03:35:16,060   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-09-05T03:35:16,061   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-09-05T03:35:16,063   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-09-05T03:35:16,064   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-09-05T03:35:16,066   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-09-05T03:35:16,068   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-09-05T03:35:16,070   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-09-05T03:35:16,071   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-09-05T03:35:16,073   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-09-05T03:35:16,074   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-09-05T03:35:16,076   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-09-05T03:35:16,078   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-09-05T03:35:16,079   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-09-05T03:35:16,081   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-09-05T03:35:16,083   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-09-05T03:35:16,084   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-09-05T03:35:16,085   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-09-05T03:35:16,087   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-09-05T03:35:16,088   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-09-05T03:35:16,090   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-09-05T03:35:16,091   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-09-05T03:35:16,093   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-09-05T03:35:16,094   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-09-05T03:35:16,096   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-09-05T03:35:16,098   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-09-05T03:35:16,099   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-09-05T03:35:16,101   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-09-05T03:35:16,103   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-09-05T03:35:16,105   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-09-05T03:35:16,107   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-09-05T03:35:16,108   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-09-05T03:35:16,110   adding 'deepspeed/launcher/__init__.py'
2024-09-05T03:35:16,111   adding 'deepspeed/launcher/constants.py'
2024-09-05T03:35:16,113   adding 'deepspeed/launcher/launch.py'
2024-09-05T03:35:16,115   adding 'deepspeed/launcher/launcher_helper.py'
2024-09-05T03:35:16,117   adding 'deepspeed/launcher/multinode_runner.py'
2024-09-05T03:35:16,121   adding 'deepspeed/launcher/runner.py'
2024-09-05T03:35:16,123   adding 'deepspeed/linear/__init__.py'
2024-09-05T03:35:16,125   adding 'deepspeed/linear/config.py'
2024-09-05T03:35:16,126   adding 'deepspeed/linear/context_manager.py'
2024-09-05T03:35:16,128   adding 'deepspeed/linear/optimized_linear.py'
2024-09-05T03:35:16,130   adding 'deepspeed/linear/quantization.py'
2024-09-05T03:35:16,133   adding 'deepspeed/model_implementations/__init__.py'
2024-09-05T03:35:16,135   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-09-05T03:35:16,136   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-09-05T03:35:16,138   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-09-05T03:35:16,140   adding 'deepspeed/model_implementations/features/__init__.py'
2024-09-05T03:35:16,141   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-09-05T03:35:16,143   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-09-05T03:35:16,144   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-09-05T03:35:16,146   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-09-05T03:35:16,147   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-09-05T03:35:16,148   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-09-05T03:35:16,149   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-09-05T03:35:16,151   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-09-05T03:35:16,152   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-09-05T03:35:16,153   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-09-05T03:35:16,155   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-09-05T03:35:16,157   adding 'deepspeed/module_inject/__init__.py'
2024-09-05T03:35:16,160   adding 'deepspeed/module_inject/auto_tp.py'
2024-09-05T03:35:16,161   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-09-05T03:35:16,163   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-09-05T03:35:16,165   adding 'deepspeed/module_inject/inject.py'
2024-09-05T03:35:16,166   adding 'deepspeed/module_inject/layers.py'
2024-09-05T03:35:16,168   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-09-05T03:35:16,170   adding 'deepspeed/module_inject/module_quantize.py'
2024-09-05T03:35:16,171   adding 'deepspeed/module_inject/policy.py'
2024-09-05T03:35:16,175   adding 'deepspeed/module_inject/replace_module.py'
2024-09-05T03:35:16,177   adding 'deepspeed/module_inject/replace_policy.py'
2024-09-05T03:35:16,178   adding 'deepspeed/module_inject/tp_shard.py'
2024-09-05T03:35:16,179   adding 'deepspeed/module_inject/utils.py'
2024-09-05T03:35:16,181   adding 'deepspeed/module_inject/containers/__init__.py'
2024-09-05T03:35:16,183   adding 'deepspeed/module_inject/containers/base.py'
2024-09-05T03:35:16,185   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-09-05T03:35:16,186   adding 'deepspeed/module_inject/containers/bert.py'
2024-09-05T03:35:16,188   adding 'deepspeed/module_inject/containers/bloom.py'
2024-09-05T03:35:16,189   adding 'deepspeed/module_inject/containers/clip.py'
2024-09-05T03:35:16,190   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-09-05T03:35:16,192   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-09-05T03:35:16,193   adding 'deepspeed/module_inject/containers/gptj.py'
2024-09-05T03:35:16,194   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-09-05T03:35:16,196   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-09-05T03:35:16,198   adding 'deepspeed/module_inject/containers/internlm.py'
2024-09-05T03:35:16,199   adding 'deepspeed/module_inject/containers/llama.py'
2024-09-05T03:35:16,201   adding 'deepspeed/module_inject/containers/llama2.py'
2024-09-05T03:35:16,202   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-09-05T03:35:16,204   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-09-05T03:35:16,206   adding 'deepspeed/module_inject/containers/opt.py'
2024-09-05T03:35:16,207   adding 'deepspeed/module_inject/containers/unet.py'
2024-09-05T03:35:16,208   adding 'deepspeed/module_inject/containers/vae.py'
2024-09-05T03:35:16,210   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-09-05T03:35:16,211   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-09-05T03:35:16,213   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-09-05T03:35:16,215   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-09-05T03:35:16,216   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-09-05T03:35:16,217   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-09-05T03:35:16,219   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-09-05T03:35:16,221   adding 'deepspeed/moe/__init__.py'
2024-09-05T03:35:16,222   adding 'deepspeed/moe/experts.py'
2024-09-05T03:35:16,223   adding 'deepspeed/moe/layer.py'
2024-09-05T03:35:16,225   adding 'deepspeed/moe/mappings.py'
2024-09-05T03:35:16,228   adding 'deepspeed/moe/sharded_moe.py'
2024-09-05T03:35:16,230   adding 'deepspeed/moe/utils.py'
2024-09-05T03:35:16,232   adding 'deepspeed/monitor/__init__.py'
2024-09-05T03:35:16,233   adding 'deepspeed/monitor/comet.py'
2024-09-05T03:35:16,235   adding 'deepspeed/monitor/config.py'
2024-09-05T03:35:16,236   adding 'deepspeed/monitor/csv_monitor.py'
2024-09-05T03:35:16,237   adding 'deepspeed/monitor/monitor.py'
2024-09-05T03:35:16,239   adding 'deepspeed/monitor/tensorboard.py'
2024-09-05T03:35:16,240   adding 'deepspeed/monitor/utils.py'
2024-09-05T03:35:16,241   adding 'deepspeed/monitor/wandb.py'
2024-09-05T03:35:16,243   adding 'deepspeed/nebula/__init__.py'
2024-09-05T03:35:16,244   adding 'deepspeed/nebula/config.py'
2024-09-05T03:35:16,246   adding 'deepspeed/nebula/constants.py'
2024-09-05T03:35:16,247   adding 'deepspeed/ops/__init__.py'
2024-09-05T03:35:16,249   adding 'deepspeed/ops/adagrad/__init__.py'
2024-09-05T03:35:16,251   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-09-05T03:35:16,252   adding 'deepspeed/ops/adam/__init__.py'
2024-09-05T03:35:16,254   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-09-05T03:35:16,256   adding 'deepspeed/ops/adam/fused_adam.py'
2024-09-05T03:35:16,257   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-09-05T03:35:16,259   adding 'deepspeed/ops/aio/__init__.py'
2024-09-05T03:35:16,261   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-09-05T03:35:16,263   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-09-05T03:35:16,265   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-09-05T03:35:16,266   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-09-05T03:35:16,267   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-09-05T03:35:16,269   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-09-05T03:35:16,272   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-09-05T03:35:16,273   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-09-05T03:35:16,275   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-09-05T03:35:16,276   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-09-05T03:35:16,277   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-09-05T03:35:16,279   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-09-05T03:35:16,281   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2024-09-05T03:35:16,282   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2024-09-05T03:35:16,283   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-09-05T03:35:16,284   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-09-05T03:35:16,286   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2024-09-05T03:35:16,287   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2024-09-05T03:35:16,288   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-09-05T03:35:16,289   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-09-05T03:35:16,291   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-09-05T03:35:16,292   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-09-05T03:35:16,293   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-09-05T03:35:16,294   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-09-05T03:35:16,296   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-09-05T03:35:16,297   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-09-05T03:35:16,299   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2024-09-05T03:35:16,300   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2024-09-05T03:35:16,302   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-09-05T03:35:16,303   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-09-05T03:35:16,306   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-09-05T03:35:16,308   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-09-05T03:35:16,311   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-09-05T03:35:16,312   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-09-05T03:35:16,314   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-09-05T03:35:16,316   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-09-05T03:35:16,318   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-09-05T03:35:16,320   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-09-05T03:35:16,322   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-09-05T03:35:16,324   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-09-05T03:35:16,332   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-09-05T03:35:16,337   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-09-05T03:35:16,339   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-09-05T03:35:16,342   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-09-05T03:35:16,344   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-09-05T03:35:16,345   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-09-05T03:35:16,347   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-09-05T03:35:16,349   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-09-05T03:35:16,352   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-09-05T03:35:16,354   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-09-05T03:35:16,356   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-09-05T03:35:16,358   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-09-05T03:35:16,366   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-09-05T03:35:16,369   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-09-05T03:35:16,371   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-09-05T03:35:16,375   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-09-05T03:35:16,379   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-09-05T03:35:16,383   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-09-05T03:35:16,385   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-09-05T03:35:16,386   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-09-05T03:35:16,388   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-09-05T03:35:16,390   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-09-05T03:35:16,392   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-09-05T03:35:16,394   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-09-05T03:35:16,396   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-09-05T03:35:16,398   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-09-05T03:35:16,400   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2024-09-05T03:35:16,401   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2024-09-05T03:35:16,403   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2024-09-05T03:35:16,404   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2024-09-05T03:35:16,406   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2024-09-05T03:35:16,407   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2024-09-05T03:35:16,409   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-09-05T03:35:16,411   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-09-05T03:35:16,412   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-09-05T03:35:16,413   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-09-05T03:35:16,415   adding 'deepspeed/ops/csrc/includes/context.h'
2024-09-05T03:35:16,416   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-09-05T03:35:16,418   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-09-05T03:35:16,419   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-09-05T03:35:16,421   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-09-05T03:35:16,422   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-09-05T03:35:16,424   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-09-05T03:35:16,426   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-09-05T03:35:16,427   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-09-05T03:35:16,428   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-09-05T03:35:16,430   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-09-05T03:35:16,431   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-09-05T03:35:16,432   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-09-05T03:35:16,434   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-09-05T03:35:16,435   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-09-05T03:35:16,438   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-09-05T03:35:16,439   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-09-05T03:35:16,441   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-09-05T03:35:16,443   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-09-05T03:35:16,444   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-09-05T03:35:16,447   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-09-05T03:35:16,449   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-09-05T03:35:16,450   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-09-05T03:35:16,451   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-09-05T03:35:16,453   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-09-05T03:35:16,455   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-09-05T03:35:16,457   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-09-05T03:35:16,458   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-09-05T03:35:16,460   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-09-05T03:35:16,461   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-09-05T03:35:16,463   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-09-05T03:35:16,464   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-09-05T03:35:16,466   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-09-05T03:35:16,469   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-09-05T03:35:16,471   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-09-05T03:35:16,473   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-09-05T03:35:16,474   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-09-05T03:35:16,476   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-09-05T03:35:16,478   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-09-05T03:35:16,480   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-09-05T03:35:16,482   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-09-05T03:35:16,483   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-09-05T03:35:16,485   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-09-05T03:35:16,487   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-09-05T03:35:16,489   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-09-05T03:35:16,490   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-09-05T03:35:16,492   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-09-05T03:35:16,494   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-09-05T03:35:16,497   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-09-05T03:35:16,501   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-09-05T03:35:16,503   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-09-05T03:35:16,505   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-09-05T03:35:16,509   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-09-05T03:35:16,512   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-09-05T03:35:16,515   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-09-05T03:35:16,517   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-09-05T03:35:16,519   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-09-05T03:35:16,522   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-09-05T03:35:16,524   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-09-05T03:35:16,526   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-09-05T03:35:16,531   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-09-05T03:35:16,533   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-09-05T03:35:16,535   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-09-05T03:35:16,538   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-09-05T03:35:16,541   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-09-05T03:35:16,543   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-09-05T03:35:16,545   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-09-05T03:35:16,547   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-09-05T03:35:16,549   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-09-05T03:35:16,551   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-09-05T03:35:16,553   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-09-05T03:35:16,554   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-09-05T03:35:16,556   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-09-05T03:35:16,558   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-09-05T03:35:16,560   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-09-05T03:35:16,561   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-09-05T03:35:16,563   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-09-05T03:35:16,564   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-09-05T03:35:16,566   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-09-05T03:35:16,568   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-09-05T03:35:16,570   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-09-05T03:35:16,571   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-09-05T03:35:16,573   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-09-05T03:35:16,574   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-09-05T03:35:16,576   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-09-05T03:35:16,578   adding 'deepspeed/ops/gds/__init__.py'
2024-09-05T03:35:16,579   adding 'deepspeed/ops/lamb/__init__.py'
2024-09-05T03:35:16,581   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-09-05T03:35:16,583   adding 'deepspeed/ops/lion/__init__.py'
2024-09-05T03:35:16,584   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-09-05T03:35:16,586   adding 'deepspeed/ops/lion/fused_lion.py'
2024-09-05T03:35:16,587   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-09-05T03:35:16,589   adding 'deepspeed/ops/op_builder/__init__.py'
2024-09-05T03:35:16,590   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-09-05T03:35:16,592   adding 'deepspeed/ops/op_builder/async_io.py'
2024-09-05T03:35:16,596   adding 'deepspeed/ops/op_builder/builder.py'
2024-09-05T03:35:16,597   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-09-05T03:35:16,599   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-09-05T03:35:16,600   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-09-05T03:35:16,602   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-09-05T03:35:16,603   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-09-05T03:35:16,604   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-09-05T03:35:16,606   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-09-05T03:35:16,607   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-09-05T03:35:16,608   adding 'deepspeed/ops/op_builder/gds.py'
2024-09-05T03:35:16,609   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-09-05T03:35:16,611   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-09-05T03:35:16,612   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-09-05T03:35:16,614   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-09-05T03:35:16,615   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-09-05T03:35:16,616   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-09-05T03:35:16,617   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-09-05T03:35:16,619   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-09-05T03:35:16,620   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-09-05T03:35:16,621   adding 'deepspeed/ops/op_builder/transformer.py'
2024-09-05T03:35:16,623   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-09-05T03:35:16,624   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-09-05T03:35:16,626   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-09-05T03:35:16,627   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-09-05T03:35:16,628   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-09-05T03:35:16,629   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-09-05T03:35:16,631   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-09-05T03:35:16,632   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-09-05T03:35:16,633   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-09-05T03:35:16,635   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-09-05T03:35:16,636   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-09-05T03:35:16,637   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-09-05T03:35:16,639   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-09-05T03:35:16,640   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-09-05T03:35:16,642   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-09-05T03:35:16,643   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-09-05T03:35:16,644   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-09-05T03:35:16,645   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-09-05T03:35:16,647   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-09-05T03:35:16,649   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-09-05T03:35:16,650   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-09-05T03:35:16,652   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-09-05T03:35:16,653   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-09-05T03:35:16,655   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-09-05T03:35:16,656   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-09-05T03:35:16,657   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-09-05T03:35:16,659   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-09-05T03:35:16,660   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-09-05T03:35:16,661   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-09-05T03:35:16,662   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-09-05T03:35:16,664   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-09-05T03:35:16,665   adding 'deepspeed/ops/quantizer/__init__.py'
2024-09-05T03:35:16,666   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-09-05T03:35:16,668   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-09-05T03:35:16,669   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-09-05T03:35:16,671   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-09-05T03:35:16,673   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-09-05T03:35:16,676   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-09-05T03:35:16,678   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-09-05T03:35:16,680   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-09-05T03:35:16,682   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-09-05T03:35:16,685   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-09-05T03:35:16,687   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-09-05T03:35:16,689   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-09-05T03:35:16,690   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-09-05T03:35:16,692   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-09-05T03:35:16,693   adding 'deepspeed/ops/transformer/__init__.py'
2024-09-05T03:35:16,696   adding 'deepspeed/ops/transformer/transformer.py'
2024-09-05T03:35:16,698   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-09-05T03:35:16,699   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-09-05T03:35:16,701   adding 'deepspeed/ops/transformer/inference/config.py'
2024-09-05T03:35:16,702   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-09-05T03:35:16,703   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-09-05T03:35:16,705   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-09-05T03:35:16,707   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-09-05T03:35:16,708   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-09-05T03:35:16,711   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-09-05T03:35:16,713   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-09-05T03:35:16,714   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-09-05T03:35:16,715   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-09-05T03:35:16,717   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-09-05T03:35:16,718   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-09-05T03:35:16,719   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-09-05T03:35:16,721   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-09-05T03:35:16,722   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-09-05T03:35:16,724   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-09-05T03:35:16,725   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-09-05T03:35:16,726   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-09-05T03:35:16,728   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-09-05T03:35:16,730   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-09-05T03:35:16,732   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-09-05T03:35:16,738   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-09-05T03:35:16,740   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-09-05T03:35:16,741   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-09-05T03:35:16,743   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-09-05T03:35:16,744   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-09-05T03:35:16,746   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-09-05T03:35:16,747   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-09-05T03:35:16,749   adding 'deepspeed/pipe/__init__.py'
2024-09-05T03:35:16,751   adding 'deepspeed/profiling/__init__.py'
2024-09-05T03:35:16,752   adding 'deepspeed/profiling/config.py'
2024-09-05T03:35:16,753   adding 'deepspeed/profiling/constants.py'
2024-09-05T03:35:16,755   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-09-05T03:35:16,760   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-09-05T03:35:16,763   adding 'deepspeed/runtime/__init__.py'
2024-09-05T03:35:16,764   adding 'deepspeed/runtime/base_optimizer.py'
2024-09-05T03:35:16,767   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-09-05T03:35:16,769   adding 'deepspeed/runtime/compiler.py'
2024-09-05T03:35:16,773   adding 'deepspeed/runtime/config.py'
2024-09-05T03:35:16,775   adding 'deepspeed/runtime/config_utils.py'
2024-09-05T03:35:16,777   adding 'deepspeed/runtime/constants.py'
2024-09-05T03:35:16,778   adding 'deepspeed/runtime/dataloader.py'
2024-09-05T03:35:16,780   adding 'deepspeed/runtime/eigenvalue.py'
2024-09-05T03:35:16,799   adding 'deepspeed/runtime/engine.py'
2024-09-05T03:35:16,803   adding 'deepspeed/runtime/hybrid_engine.py'
2024-09-05T03:35:16,806   adding 'deepspeed/runtime/lr_schedules.py'
2024-09-05T03:35:16,808   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-09-05T03:35:16,810   adding 'deepspeed/runtime/quantize.py'
2024-09-05T03:35:16,811   adding 'deepspeed/runtime/sparse_tensor.py'
2024-09-05T03:35:16,813   adding 'deepspeed/runtime/state_dict_factory.py'
2024-09-05T03:35:16,818   adding 'deepspeed/runtime/utils.py'
2024-09-05T03:35:16,820   adding 'deepspeed/runtime/weight_quantizer.py'
2024-09-05T03:35:16,822   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-09-05T03:35:16,827   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-09-05T03:35:16,828   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-09-05T03:35:16,830   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-09-05T03:35:16,831   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-09-05T03:35:16,833   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-09-05T03:35:16,834   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-09-05T03:35:16,836   adding 'deepspeed/runtime/comm/__init__.py'
2024-09-05T03:35:16,837   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-09-05T03:35:16,839   adding 'deepspeed/runtime/comm/compressed.py'
2024-09-05T03:35:16,840   adding 'deepspeed/runtime/comm/hccl.py'
2024-09-05T03:35:16,842   adding 'deepspeed/runtime/comm/mpi.py'
2024-09-05T03:35:16,844   adding 'deepspeed/runtime/comm/nccl.py'
2024-09-05T03:35:16,845   adding 'deepspeed/runtime/compression/__init__.py'
2024-09-05T03:35:16,846   adding 'deepspeed/runtime/compression/cupy.py'
2024-09-05T03:35:16,848   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-09-05T03:35:16,849   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-09-05T03:35:16,851   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-09-05T03:35:16,853   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-09-05T03:35:16,854   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-09-05T03:35:16,856   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-09-05T03:35:16,857   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-09-05T03:35:16,859   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-09-05T03:35:16,860   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-09-05T03:35:16,862   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-09-05T03:35:16,867   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-09-05T03:35:16,870   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-09-05T03:35:16,873   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-09-05T03:35:16,874   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-09-05T03:35:16,876   adding 'deepspeed/runtime/fp16/__init__.py'
2024-09-05T03:35:16,878   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-09-05T03:35:16,880   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-09-05T03:35:16,883   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-09-05T03:35:16,885   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-09-05T03:35:16,887   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-09-05T03:35:16,890   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-09-05T03:35:16,893   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-09-05T03:35:16,894   adding 'deepspeed/runtime/pipe/__init__.py'
2024-09-05T03:35:16,902   adding 'deepspeed/runtime/pipe/engine.py'
2024-09-05T03:35:16,906   adding 'deepspeed/runtime/pipe/module.py'
2024-09-05T03:35:16,908   adding 'deepspeed/runtime/pipe/p2p.py'
2024-09-05T03:35:16,910   adding 'deepspeed/runtime/pipe/schedule.py'
2024-09-05T03:35:16,913   adding 'deepspeed/runtime/pipe/topology.py'
2024-09-05T03:35:16,915   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-09-05T03:35:16,916   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-09-05T03:35:16,918   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-09-05T03:35:16,919   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-09-05T03:35:16,921   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-09-05T03:35:16,923   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-09-05T03:35:16,926   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-09-05T03:35:16,928   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-09-05T03:35:16,929   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-09-05T03:35:16,931   adding 'deepspeed/runtime/zero/__init__.py'
2024-09-05T03:35:16,934   adding 'deepspeed/runtime/zero/config.py'
2024-09-05T03:35:16,936   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-09-05T03:35:16,938   adding 'deepspeed/runtime/zero/linear.py'
2024-09-05T03:35:16,941   adding 'deepspeed/runtime/zero/mics.py'
2024-09-05T03:35:16,944   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-09-05T03:35:16,945   adding 'deepspeed/runtime/zero/offload_config.py'
2024-09-05T03:35:16,948   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-09-05T03:35:16,960   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-09-05T03:35:16,964   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-09-05T03:35:16,965   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-09-05T03:35:16,982   adding 'deepspeed/runtime/zero/stage3.py'
2024-09-05T03:35:16,996   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-09-05T03:35:16,998   adding 'deepspeed/runtime/zero/test.py'
2024-09-05T03:35:17,000   adding 'deepspeed/runtime/zero/tiling.py'
2024-09-05T03:35:17,002   adding 'deepspeed/runtime/zero/utils.py'
2024-09-05T03:35:17,003   adding 'deepspeed/sequence/__init__.py'
2024-09-05T03:35:17,005   adding 'deepspeed/sequence/cross_entropy.py'
2024-09-05T03:35:17,006   adding 'deepspeed/sequence/layer.py'
2024-09-05T03:35:17,008   adding 'deepspeed/utils/__init__.py'
2024-09-05T03:35:17,010   adding 'deepspeed/utils/bwc.py'
2024-09-05T03:35:17,011   adding 'deepspeed/utils/comms_logging.py'
2024-09-05T03:35:17,013   adding 'deepspeed/utils/config.py'
2024-09-05T03:35:17,014   adding 'deepspeed/utils/debug.py'
2024-09-05T03:35:17,015   adding 'deepspeed/utils/exceptions.py'
2024-09-05T03:35:17,018   adding 'deepspeed/utils/groups.py'
2024-09-05T03:35:17,020   adding 'deepspeed/utils/init_on_device.py'
2024-09-05T03:35:17,021   adding 'deepspeed/utils/logging.py'
2024-09-05T03:35:17,023   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-09-05T03:35:17,024   adding 'deepspeed/utils/numa.py'
2024-09-05T03:35:17,026   adding 'deepspeed/utils/nvtx.py'
2024-09-05T03:35:17,027   adding 'deepspeed/utils/tensor_fragment.py'
2024-09-05T03:35:17,029   adding 'deepspeed/utils/timer.py'
2024-09-05T03:35:17,031   adding 'deepspeed/utils/torch.py'
2024-09-05T03:35:17,032   adding 'deepspeed/utils/types.py'
2024-09-05T03:35:17,033   adding 'deepspeed/utils/z3_leaf_module.py'
2024-09-05T03:35:17,036   adding 'deepspeed/utils/zero_to_fp32.py'
2024-09-05T03:35:17,038   adding 'deepspeed-0.15.1.data/scripts/deepspeed'
2024-09-05T03:35:17,039   adding 'deepspeed-0.15.1.data/scripts/deepspeed.pt'
2024-09-05T03:35:17,041   adding 'deepspeed-0.15.1.data/scripts/ds'
2024-09-05T03:35:17,042   adding 'deepspeed-0.15.1.data/scripts/ds_bench'
2024-09-05T03:35:17,043   adding 'deepspeed-0.15.1.data/scripts/ds_elastic'
2024-09-05T03:35:17,044   adding 'deepspeed-0.15.1.data/scripts/ds_report'
2024-09-05T03:35:17,045   adding 'deepspeed-0.15.1.data/scripts/ds_ssh'
2024-09-05T03:35:17,047   adding 'deepspeed-0.15.1.data/scripts/dsr'
2024-09-05T03:35:17,050   adding 'deepspeed-0.15.1.dist-info/LICENSE'
2024-09-05T03:35:17,055   adding 'deepspeed-0.15.1.dist-info/METADATA'
2024-09-05T03:35:17,056   adding 'deepspeed-0.15.1.dist-info/WHEEL'
2024-09-05T03:35:17,057   adding 'deepspeed-0.15.1.dist-info/entry_points.txt'
2024-09-05T03:35:17,058   adding 'deepspeed-0.15.1.dist-info/top_level.txt'
2024-09-05T03:35:17,072   adding 'deepspeed-0.15.1.dist-info/RECORD'
2024-09-05T03:35:17,100   removing build/bdist.linux-armv7l/wheel
2024-09-05T03:35:17,309   deepspeed build time = 10.389318466186523 secs
2024-09-05T03:35:17,414   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-09-05T03:35:17,432   Created wheel for deepspeed: filename=deepspeed-0.15.1-py3-none-any.whl size=1483784 sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598
2024-09-05T03:35:17,433   Stored in directory: /tmp/pip-ephem-wheel-cache-odb9bfew/wheels/f6/9c/9f/b2db425455da4c5ecd0e4ab582ef2e9cf0f6cbb36ce9f50203
2024-09-05T03:35:17,474 Successfully built deepspeed
2024-09-05T03:35:17,522 Removed build tracker: '/tmp/pip-build-tracker-c_h6bql7'